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FOREWORD 


Work  at  the  Navy  Personnel  Research  and  Development  Center  aimed  at  improving 
the  Navy's  officer  performance  evaluation  system  was  conducted  under  Exploratory 
Development  task  areas  Career  and  Occupational  Design  (RF63-521-804-031)  and  Future 
Technologies  for  Manpower  and  Personnel  (RF63-52 1-806). 

This  report  describes  results  of  an  anonymous  mail-back  survey  of  over  300  Pacific 
Fleet  officers  who  were  asked  to  respond  to  a  questionnaire  covering  various  aspects  of 
the  performance  evaluation  system.  A  companion  report  (NPRDC  TR  85-6)  describes 
results  of  an  intensive  review  of  pertinent  literature  of  the  past  two  decades.  A  summary 
of  this  report  appears  as  Appendix  B  in  the  present  report. 


3.  W.  RENARD 
Captain,  U.5.  Navy 
Commanding  Officer 


3.  W.  TWEEDDALE 
Technical  Director 
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SUMMARY 


Problem 


The  Navy's  Report  on  the  Fitness  of  Officers  (FITREP)  is  the  major  document  used 
for  evaluating  naval  officer  performance.  The  FITREP  serves  (1)  as  a  record  of  the  senior 
officer's  evaluation  of  the  performance  of  his/her  subordinates  and,  hence,  as  a  basis  for 
decisions  concerning  promotion,  retention,  assignment,  and  training,  and  (2)  as  a  focal 
point  and  stimulus  for  the  performance  counseling  of  the  subordinate  officer  by  his/her 
reporting  senior.  The  major  problem  in  using  the  FITREP  for  evaluating  performance  is 
rating  inflation;  that  is,  the  nearly  overwhelming  tendency  for  ratings  to  be  concentrated 
at  the  high  end  of  the  scale.  Although  problems  with  performance  counseling  are 
complex,  they  appear  to  be  primarily  due  to  the  interpersonal  discomfort  associated  with 
such  evaluations  and  a  lack  of  incentives  for  candor  from  both  parties. 

Purpose 

i 

The  purposes  of  this  project  were  to  (1)  identify,  for  possible  Navy  use,  innovative 
strategies,  procedures,  or  rating  formats  that  might  be  useful  in  curbing  inflation  in 
performance  ratings,  and  (2)  identify  and  propose  solutions  to  the  obstacles  that  hinder 
effective  performance  feedback. 

Approach 

Over  300  Pacific  Fleet  officers  were  asked  to  respond  to  a  structured  questionnaire 
covering  various  aspects  of  the  performance  evaluation  system.  A  companion  report 
describes  data  obtained  by  reviewing  the  pertinent  research  literature  and  interviewing 
fleet  officers  and  cognizant  persons  in  the  Naval  Military  Personnel  Command. 

Findings 


1.  Overall,  officers  are  satisfied  with  the  current  officer  evaluation  system.  The 
most-liked  feature  of  the  current  system  is  the  use  of  a  single  form  for  all  grades, 
followed  by  the  narrative  evaluation  and  ranking  of  officers  among  their  peers.  By  far, 
the  least-liked  attribute  is  grade  inflation.  Also  disliked  are  the  quality  and  quantity  of 
counseling,  subjectivity,  and  the  amount  of  effort  required  to  complete  the  form. 

2.  Even  though  the  narrative  section  of  the  FITREP  is  popular,  it  is  also  the  most 
frequent  subject  of  negative  comments.  Officers  feel  the  narrative  is  too  subjective,  too 
long,  and  too  influenced  by  the  writer's  literary  ability.  Peer  ranking,  another  popular 
feature,  is  also  criticized.  The  comments  are  not  against  peer  ranking  per  se  but,  rather, 
against  the  composition  and  size  of  the  comparison  group. 

3.  Ninety-five  percent  of  the  respondents  feel  grade  inflation  is  a  problem.  The 
perception  that  inflation  exists  is  supported  by  the  officers'  self-reported  scores  on  their 
last  FITREP:  85  percent  received  the  highest  mark,  while  13  percent  received  the  second 
highest  mark.  The  most  recommended  method  for  reducing  grade  inflation  is  to  place 
more  emphasis  on  the  narrative  section  of  the  FITREP  and  less  on  letter  or  number 
grades.  When  four  alternatives  to  the  current  rating  formats,  Blocks  51  and  52  of  the 
FITREP,  were  offered,  only  one,  the  "total  range  of  officer  value"  scale,  was  rated  highly 
enough  to  justify  further  research. 


4.  3ob  clarification  does  not  seem  to  be  a  pressing  issue;  nevertheless,  over  80 
percent  of  the  respondents  felt  that  there  should  be  a  formal  procedure  for  clarifying  the 
subordinate's  duties.  Officers  felt  that  a  formal  discussion  of  assignment  should  take 
place  12  months  before  a  FITREP  and  a  formal  performance  review  6  months  before  a 
FITREP. 

Recommendations 

Based  on  results  of  the  entire  project,  it  is  recommended  that  the  Navy's  FITREP  4 

system  be  modified  as  follows: 

1.  Implement  a  beginning-of-year  assignment  conference  and  midyear  assignment 
review  conference  between  the  ratee  and  the  reporting  senior,  to  be  held  12  and  6  months 
prior  to  the  FITREP  completion  date.  These  interviews  are  intended  to  ensure  mutual  and 
clear  understanding  of  the  subordinate's  duties  and  priorities.  Such  circumstances  as 
change  of  command  or  reassignment  of  an  officer  must  be  provided  for  in  implementing 
instructions. 

2.  Revise  the  appraisal  worksheet  by  providing  expanded  definitions  of  the  traits. 

3.  Revise  the  current  FITREP  form  by  (a)  reducing  space  for  the  narrative,  (b) 
requiring  that  the  narrative  describe  specific  accomplishments,  (c)  implementing  an 
"evaluation  of  potential"  section,  (d)  deleting  blocks  53-56  and  77-79  ("trend  of  perfor¬ 
mance"  and  "weaknesses  discussed"),  and  (e)  including  the  "total  range  of  officer  value" 
scale  on  an  experimental  basis. 

4.  Develop  rater  profiles  for  the  "evaluation  of  potential"  section,  with  a  feedback 
and  enforcement  mechanism  for  dealing  with  flagrant  inflators. 

5.  Introduce  all  changes  with  a  significant  educational  campaign,  beginning  several 
months  prior  to  actual  system  changes. 

6.  Initiate  preliminary  research  directed  toward  developing  an  interactive  computer 
graphics  system  that  would  enable  selection  boards  to  make  on-line  inquires  of  a  data  base 
consisting  of  all  FITREP  data  for  ratees. 

7.  Make  more  use  of  provisions  in  the  recently  enacted  Defense  Officer  Personnel 
Management  Act  (DOPMA)  enabling  selective  waiver  of  the  up-or-out  system.  These 
provisions  should  be  broadened  to  permit  a  larger  range  of  exceptions  to  up-or-out.  Such 
policy  modifications  will  become  increasingly  important  as  large  numbers  of  officers 
become  involved  in  narrow  but  vitally  important  areas  of  specialization  (e.g.,  computer 
technology). 
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INTRODUCTION 


Problem  and  Background 

The  Report  on  the  Fitness  of  Officers  (FITREP)  (Appendix  A,  Figure  A-l),  the 
principal  document  used  to  manage  the  career  of  U.S.  Navy  officers,  has  two  broad  but 
distinct  purposes.  First,  it  serves  as  a  record  of  the  senior  officer's  evaluation  of  his/her 
subordinates  and,  hence,  as  a  basis  for  decisions  affecting  the  ratee's  future  in  the  Navy 
(e.g.,  those  involving  retention,  promotion,  training,  assignment,  and  selection  for 
command).  Second,  it  serves  as  a  performance  counseling  device.  The  Appraisal 
Worksheet  (Figure  A-2),  which  is  used  in  preparing  the  FITREP,  is  intended  for  use  by  the 
reporting  senior  during  the  performance  appraisal  discussion.1 

Many  problems  limit  the  FITREP's  effectiveness  in  filling  either  role.  Inflated 
evaluations  have  so  greatly  reduced  the  spread  of  performance  ratings  that  their 
usefulness  to  selection  and  promotion  boards  may  be  limited.  As  a  result,  decisions 
affecting  officers’  careers  may  be  based  on  factors  other  than  performance-certainly 
undesirable  for  both  the  officers  and  the  Navy.  The  problems  with  using  the  FITREP  for 
performance  counseling  are  due  to  many  factors,  including  system  design,  a  lack  of 
incentives,  and  what  McGregor  (1972)  attributes  to  the  supervisors'  unwillingness  to 
accept  the  role  of  "playing  God." 

Larson  and  Rimland  (1984)  addressed  two  of  the  most  serious  problems  with  the 
current  Navy  FITREP  system:  (1)  inflation  of  performance  ratings,  and  (2)  the  FITREP's 
weaknesses  as  a  performance  counseling  tool.  Data  were  obtained  by  reviewing  the 
pertinent  research  literature  and  interviewing  fleet  officers  and  cognizant  persons  in  the 
Naval  Military  Personnel  command.  Results  are  summarized  in  Appendix  B. 

Purpose 

The  purpose  of  the  present  effort  was  to  survey  a  diverse  sample  of  Navy  officers  to 
determine  how  satisfied  they  were  with  the  present  evaluation  system,  what  specific 
aspects  they  liked  and  disliked,  and  how  they  would  recommend  that  the  system  be 
improved.  Two  key  issues  addressed  were  inflation  of  performance  ratings  and  the 
effectiveness  of  the  evaluation  system  as  a  performance  counseling  tool. 


APPROACH 

The  survey,  a  copy  of  which  is  provided  as  Appendix  C,  was  planned  as  an  informal, 
low-key  effort  to  provide  additional  data  for  ongoing  research  on  the  FITREP  system. 
Responses  were  requested  from  the  three  major  warfare  areas  in  the  Navy— the  surface, 
air,  and  submarine  forces;  however,  only  the  Pacific  Fleet  activities  listed  in  Table  1  were 
surveyed. 

Since  the  data  are  based  on  a  nonrandom  sample,  the  findings  will  not  necessarily  be 
applicable  Navy-wide.  However,  as  will  be  noted  later  (pages  5  and  6),  there  is  little 
reason  to  expect  substantial  sampling  distortion  of  the  findings  across  officers  in  the 
Pacific  Fleet.  It  is  unknown  how  the  Atlantic  Fleet  might  differ. 


^AVMILPERSCOMINST  1611.1.  Subject:  Report  on  the  fitness  of  officers,  12  May 

1981.  ’  y 
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Table  1 


Fleet  Activities  Surveyed 


Activity 

Number  of  Question¬ 
naires  Distributed 

Fleet  Anti-Submarine  Warfare  Training  Center,  Pacific 

55 

Shore  Intermediate  Maintenance  Activity,  San  Diego 

40 

Commander  Submarine  Group  FIVE 

50 

Cruiser-Destroyer  Group  THREE 

50 

USS  DENVER  (LPD  9) 

30 

USS  BELLEAU  WOOD  (LHA  3) 

60 

San  Diego  based  aviation  squadrons 

150 

Total 

435 

RESULTS  AND  CONCLUSIONS 


Background 

A  total  of  308  questionnaires  was  returned,  for  an  apparent  return  rate  of  71  percent. 
However,  this  return  rate  cannot  be  taken  at  face  value  because  some  commands  made 
additional  copies  of  the  survey  and  others  may  not  have  distributed  all  the  copies  that 
were  provided. 

Survey  items  1  through  7  asked  respondents  to  provide  background  information. 
Table  2,  which  describes  the  sample  by  status,  gender,  rank,  and  designator,  shows  that 
the  respondents  were  primarily  regular  Navy,  male,  career  officers.  More  than  half  were 
Lieutenant  Commanders  (LCDRs)  or  higher,  with  aviation  officers  predominating.  'Table 
3,  which  provides  a  breakdown  by  rank  within  officer  type,  shows  that  79  percent  of  the 
aviation  force  and  69  percent  of  the  subsurface  force  were  LCDRs  or  above,  compared  to 
only  34  percent  for  the  surface. 

An  additional  background  variable  expected  to  influence  survey  responses  was  the 
number  of  FITREPs  written.  Table  4  shows  the  number  written  by  respondents  during  the 
past  12  months  and  during  their  entire  career.  Table  5  shows  the  background  character¬ 
istics  of  those  who  had  no  (0  reports),  some  (from  1-25  reports),  and  much  (over  26 
reports)  experience  in  writing  FITREPs  during  their  career.  Those  with  no  experience 
were  more  likely  to  be  reserves,  females,  and  01-03  junior  officers  from  the  surface 
force  than  were  those  with  some  or  much  experience.  When  regular/reserve  status, 
gender,  rank,  and  type  of  officer  were  used  to  predict  career  experience  with  FITREPs,  50 
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Table  2 


Description  of  Sample  (N  =  308) 


Item 

Number 

Percent 

Status: 

U.S.  Navy 

264 

86 

Other 

44 

14 

U.S.  Navy  Reserve 

(42) 

(14) 

Training  and  Administration  Reserve  (TAR) 

(02) 

(01) 

Gender: 

Male 

292 

95 

Female 

16 

5 

Rank: 

Warrant  officers 

12 

4 

01-03  officers: 

126 

41 

Ensign  (ENS) 

(12) 

(04) 

Lieutenant  Junior  Grade  (LTJG) 

(33) 

(11) 

Lieutenant  (LT) 

(81) 

(26) 

04-06  Officers:3 

170 

55 

Lieutenant  Commander  (LCDR) 

(85) 

(28) 

Commander  (CDR) 

(62) 

(20) 

Captain  (CAPT) 

(22) 

(07) 

Rear  Admiral  (RADM)3 

(01) 

(00) 

Designator/Type  of  officer: 

Unrestricted  Aviation  (13XX) 

107 

35 

Unrestricted  Surface  (119X,  11 IX,  114X,  116X) 
Unrestricted  Submarine  (112X,  117X) 

77 

25 

36 

12 

Other: 

88 

29 

Restricted  Line  (14XX,  15XX,  16XX) 

(16) 

(05) 

Staff  Corps  (2XXX,  3XXX,  4XXX,  5XXX) 

General  Unrestricted  Line  (11  OX) 

(27) 

(09) 

(18) 

(06) 

Limited  Duty  (6XXX) 

(15) 

(05) 

Warrant  (7XXX) 

(12) 

(04) 

Note.  Percentage  totals  do  not  always  equal  100  due  to  rounding.  Numbers  in 
parentheses  are  subtotals  of  the  preceding  category. 


3 

Also  includes  one  Rear  Admiral,  but  the  label  04-06  is  more  descriptive  of  the  sample. 


3 


Table  3 


Rank  by  Designated  Type  of  Officer 


Warrant 

01-03 

04-06 

Total 

Type  of  Officer 

N 

% 

N 

% 

N 

% 

N 

% 

Unrestricted  Aviation 

_ 

_  _ 

22 

21 

85 

79 

107 

100 

Unrestricted  Surface 

— 

-- 

51 

66 

26 

34 

77 

100 

Unrestricted  Subsurface 

-- 

-- 

11 

31 

25 

69 

36 

100 

Other 

11 

J_4 

42 

48 

34 

39 

88 

100 

Total 

12 

4 

126 

41 

170 

55 

308 

100 

Table  4 

Experience  with  FITREPs 


Frequency 

N 

% 

Number  Written  in  Past  12  Months 

None 

109 

35 

1-5 

93 

30 

Over  5: 

97 

31 

6-10 

(31) 

(10) 

11-19 

(27) 

(09) 

20-29 

(17) 

(05) 

30+ 

(22) 

(07) 

No  response 

9 

3 

Number  Written  During  Career 

None 

70 

23 

1-25 

86 

28 

Over  25: 

122 

39 

26-49 

(31) 

(10) 

50-74 

(32) 

(10) 

75-99 

(12) 

(04) 

100+ 

(47) 

(15) 

No  response 

30 

10 

Note.  Percentage  totals  do  not  always  equal  100  due  to  rounding. 

f 
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Table  5 


Background  Characteristics  by  Level  of  Experience  in  Writing  FITREPs 


Characteristic 


No  Exp. 
(0  reports) 
(N  =  70) 
(%) 


Number  of  Reports  Written 


Some  Exp. 
(1-25  reports) 
(N  =  86) 

(%) 


Much  Exp. 
(26+  reports) 
(N  =  122) 
(%) 


Status: 


USN 

20 

31 

49 

USNR/TAR 

59 

28 

13 

Gender: 

Males 

24 

31 

45 

Females 

44 

38 

19 

Rank: 

Warrant  officer 

40 

40 

20 

01-03  officer 

58 

33 

8 

04-06  officer 

2 

29 

69 

Type  of  officer: 

Unrestricted  aviation 

10 

30 

60 

Unrestricted  surface 

42 

32 

26 

Unrestricted  subsurface 

23 

14 

63 

Other 

33 

38 

29 

Note.  Based  on  a  sample  size  of  278;  30  people  did  not  answer  the  question  on  how  many 
FITREPs  they  had  written  in  their  career. 


percent  of  the  variance  was  accounted  for.2  The  significant  characteristic  is  rank,  with 
warrant  officers  falling  between  junior  officers  and  senior  officers. 

Because  the  sample  was  not  selected  such  that  results  could  be  generalized  to  all 
Navy  officers,  it  was  particularly  important  to  test  for  biases  resulting  from  respondent 
characteristics.  Thus,  five  background  variables  were  evaluated: 

1.  Rank— 3  levels:  Warrant,  01-03  and  04-06  officers. 

2.  Officer  type— 4  levels:  Aviation,  surface,  subsurface,  and  other. 

3.  Gender— 2  levels:  Males  and  females. 

4.  Status— 2  levels:  Regular  and  reserve. 


The  procedure  used  was  a  general  linear  model  using  dummy  variables  with  two 
levels  of  gender  and  regular/reserve  status,  three  levels  of  rank,  and  four  levels  of  officer 
type,  and  no  interaction  terms  (F(7,270)  =  39.47,  p  =  .0001). 
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5.  FITREP  experience  during  career— 3  levels:  None  (0  written),  some  (1-25 
written),  and  much  (26+  written). 

These  five  variables  were  used  in  a  multivariate  analysis  of  variance  (ANOVA)  model  with 
main  effects  only.  Sixty  questionnaire  items  were  grouped  into  three  clusters  of 
dependent  variables.  The  first  cluster  was  composed  of  28  items  on  characteristics  most 
and  least  liked  about  the  current  FITREP  system;  the  second,  18  items  on  methods 
recommended  to  reduce  grade  inflation;  and  the  third,  14  items  on  satisfaction  with  the 
current  system  and  proposed  alternatives.  Each  cluster  was  analyzed  separately.  Results 
showed  that  none  of  the  variables  were  significant.  The  only  noteworthy  trend  was  that 
experience  with  writing  FITREPs  was  a  possible  source  of  variation  for  the  items  on 
recommended  methods  to  reduce  grade  inflation  (p  <  .10). 

Since  it  appears  that  rank,  officer  type,  gender,  and  regular/reserve  status  do  not 
affect  how  officers  perceive  their  current  performance  evaluation  system  nor  how  they 
evaluate  proposed  changes,  the  rest  of  the  results  will  be  presented  aggregated  across 
respondents  and  can,  in  the  main,  be  considered  to  represent  naval  officers  in  the  Pacific 
Fleet.  Occasionally,  group  results  are  reported  where  differences  in  percentages  or 
means  seem  worth  noting  (i.e.,  the  univariate  ANOVA  or  chi  square  tests  were  significant 
at  the  .10  level).  Because  the  multivariate  tests  were  nonsignificant,  the  univariate 
results  should  be  interpreted  as  trends  that,  if  consistent  with  findings  from  related  items, 
might  be  useful  in  planning  future  studies. 

Satisfaction  with  the  Present  System 

Item  8  asked  respondents  to  indicate  how  satisfied  they  were  with  the  current  officer 
evaluation  system  overall,  using  a  5-point  scale  ranging  from  very  satisfied  to  very 
dissatisfied.  Sixty-three  percent  responded  that  they  were  very  satisfied  or  satisfied,  10 
percent,  undecided;  23  percent  dissatisfied,  and  3  percent,  very  dissatisfied.  Item  19  was 
more  specific— it  asked  respondents  how  satisfied  they  were  with  Blocks  51  and  52  on  the 
current  FITREP  form.  Block  51  is  used  by  the  rater  to  evaluate  an  officer;  and  Block  52, 
to  summarize  how  he  or  she  has  rated  officers  of  the  same  rank  and  competitive  category 
within  the  current  cycle.  Seventy-six  percent  responded  that  the  blocks  were  very 
satisfactory  or  satisfactory.  Thus,  it  appears  that  officers  perceived  the  present  system 
as  working  quite  well.  However,  only  53  percent  of  those  who  had  never  written  a 
FITREP  were  satisfied  with  the  overall  system,  compared  to  67  percent  of  those  who  had 
written  at  least  one  FITREP. 

Item  9  listed  14  characteristics  of  the  current  system  and  asked  respondent  to  select 
the  3  they  liked  most  and  the  3  they  liked  least.  Table  6  shows  that  the  most-liked 
feature  was  the  use  of  a  single  form  for  all  grades,  with  60  percent  selecting  this  feature. 
Four  other  popular  attributes  (in  order  of  preference)  were  the  narrative  evaluation 
section  of  the  FITREP  (56%),  ranking  of  officers  among  their  peers  (46%),  opportunity  for 
input  by  those  evaluated  (31%),  and  the  letter  grade  evaluation  (30%).  The  five  least- 
liked  characteristics  were  grade  inflation  (78%),  quality  of  counseling  received  (35%), 
quantity  of  counseling  received  (29%),  subjectivity  (27%),  and  the  amount  of  effort 
required  to  complete  the  form  (21%).  The  conclusions  one  might  draw  from  these  results 
are  that,  in  any  reform  of  the  evaluation  system,  a  single  form  for  all  grades  should  be 
retained  and  there  should  be  an  opportunity  for  narrative  comments  and  ranking  among 
peers.  On  the  other  hand,  reform  should  deal  with  the  problems  of  grade  inflation  and 
counseling  opportunities. 

The  amount  of  experience  respondents  had  in  writing  FITREPs  appears  to  have 
influenced  the  desirability  of  several  characteristics.  Table  7  shows  that  officers  with 
much  experience  liked  the  use  of  a  single  form  for  all  grades,  fairness,  ranking  among 
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Table  6 


Characteristics  Respondents  Liked  Most  and  Least  About  the  Current  FITREP  System 


Characteristic  Like  Most  Like  Least 

(%)  (%) 


Single  form  for  all  grades 

60 

5 

Narrative  evaluation 

56 

12 

Ranking  among  peers 

46 

18 

Opportunity  for  ratee  input 

31 

6 

Letter  grade  evaluation 

30 

12 

Work  sheet 

18 

10 

Fairness 

15 

14 

Objectivity 

14 

8 

Effort  required  to  complete  form 

9 

21 

Governing  instructions 

7 

14 

Subjectivity 

7 

27 

Quality  of  counseling  received 

3 

35 

Quantity  of  counseling  received 

1 

29 

Grade  inflation 

0 

78 

Note.  The  percentages  add  up  to  more  than  100  because  each  person  was  requested  to 
mark  the  top  three  likes  and  the  top  three  dislikes. 


Table  7 

Characteristics  Most  and  Least  Liked  by  Respondents'  Level  of 
Experience  in  Writing  FITREPs  During  Their  Career 


Experience_ j 

No  Exp.  Some  Exp.  Much  Exp. 

(0  Rpts)  (1-25  Rpts)  (26+  Rpts) 


Characteristic 

Like 

Most 

(%) 

Dislike 

Most 

(%) 

Like 

Most 

(%) 

Dislike 

Most 

(%) 

Like 

Most 

(%) 

Dislike 

Most 

(%) 

Single  form  for  all  grades 

47 

_  _ 

58 

68 

Fairness 

11 

— 

8 

21 

_  _ 

Opportunity  for  ratee  input 

41 

11 

36 

2 

25 

3 

Ranking  among  peers 

36 

26 

49 

13 

53 

11 

Narrative  evaluation 

69 

— 

59 

_  _ 

47 

_  _ 

Governing  instructions 

1 

-- 

6 

— 

11 

— 

Note.  Differences  in  responses  to  items  listed  were  all  statistically  significant  at  the  .10 
level  for  a  2  x  3  y2. 
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peers,  and  governing  instructions  more  than  did  officers  with  some  or  no  experience; 
however,  fairness  of  the  current  system  and  governing  instructions  were  not  particularly 
popular  among  any  group.  Officers  with  no  experience  liked  the  narrative  evaluation  and 
the  opportunity  for  ratee  input  more  than  did  those  with  some  or  much  experience.  Also, 
the  inexperienced  officers  disliked  opportunity  for  ratee  input  and  ranking  among  peers 
more  than  did  other  groups.  Inexperienced  officers,  it  seems,  have  stronger  feelings  both 
pro  and  con  about  ratee  input  into  the  fitness  report.  Overall,  it  appears  that  experienced 
officers  liked  the  quantitative  and  structured  aspects  of  the  present  system,  while  the  less 
experienced  preferred  the  qualitative  aspects. 

Item  10  asked  respondents  to  list  any  additional  characteristics  of  the  FITREP  system 
that  they  particularly  liked  or  disliked.  Many  officers  used  this  question  to  discuss 
characteristics  already  appearing  on  the  list,  rather  than  generate  new  ones.  However,  28 
mentioned  aspects  they  liked;  and  53,  those  they  disliked.  The  frequency  distributions  of 
response  categories  are  listed  in  Table  8. 3 

There  were  several  interesting  contrasts  between  the  written  and  structured 
responses.  Even  though  56  percent  of  the  respondents  had  selected  the  narrative 
evaluation  as  one  of  the  most-liked  characteristics,  it  was  also  the  most  frequent  subject 
of  negative  comments  (N  =  22).  Specifically,  10  officers  remarked  on  the  problem  of 
subjectivity  and  the  importance  of  the  writer's  literary  ability.  Four  indicated  that  a 
"secret"  language  exists  that  is  used  by  the  review  boards  but  that  is  known  by  only  some 
report  writers.  They  thought  that  the  use  of  these  "secret  words"  was  the  difference 
between  a  positive  and  negative  evaluation.  Finally,  eight  felt  that  the  narrative  section 
is  too  long,  which  tends  to  amplify  the  problems  already  mentioned.  They  recommended 
that  the  narrative  section  be  limited,  perhaps  by  confining  the  space  or  requiring  bulleted 
remarks. 

Ranking  among  peers  was  the  disliked  characteristic  next  most  frequently  mentioned. 
Again,  although  46  percent  had  selected  peer  ranking  as  one  of  the  most-liked  character¬ 
istics,  eight  written  comments  indicated  dissatisfaction  with  this  procedure.  The 
comments  were  not  against  peer  ranking  per  se;  rather,  they  expressed  concern  regarding 
the  composition  and  size  of  the  comparison  group.  A  typical  comment  was,  "Not  really 
disenchanted  with  the  current  system  except  that  there  is  no  way  not  to  hurt  good 
officers  in  large  commands."  Some  suggested  that  there  should  be  Navy-wide  as  well  as 
command  comparisons. 

Grade  Inflation 


As  indicated  previously,  the  research  team  identified  grade  inflation  and  counseling 
opportunities  for  in-depth  probing  on  the  questionnaire.  Thus,  item  11  asked  respondents 
whether  they  felt  grade  inflation,  defined  as  the  tendency  for  nearly  everyone  to  be  rated 
4.0,  was  a  problem.  Ninety-five  percent  of  the  respondents  felt  it  was  a  problem.  Of 
those,  73  percent  felt  it  could  possibly  be  reduced. 

The  perception  that  grade  inflation  exists  is  supported  by  the  responses  to  item  28, 
which  asked  the  officers  to  give  their  last  FITREP  rating.  Of  the  289  officers  who 
answered  the  question,  245  (85%)  reported  having  received  the  highest  mark;  and  37 
(13%),  the  second  highest  mark.  What  limited  variance  there  was  in  ratings  was  best 
predicted  by  regular/reserve  status  and  rank. 


Supplement  1  to  this  report  provides  responses  to  all  open-ended  questions.  Copies 
may  be  obtained  by  contacting  the  Navy  Personnel  Research  and  Development  Center, 
Code  71. 
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Table  8 


Contributed  Comments  on  Characteristics  of 
the  Current  FITREP  System 


Response  Category 

Frequency 

Liked  (Question  10a) 

Annual  performance  review,  good  feedback 

c 

Narrative  evaluation  section 

o 

h 

Ranking 

*r 

u 

Copy  to  officer 

Simple,  easy  to  understand,  very  readable 

D 

2 

Excellent  counseling  device 

tm 

2 

Other 

7 

Total 

28 

Disliked  (Question  10b) 

Narrative  subjective;  lacks  standards 
Narrative  should  be  limited 
Ranking  among  peers 

Words  used  in  the  narrative  evaluation  carries 
special  ("secret")  meaning 
Rated  traits  are  not  the  best  choice 
Forced  grade  inflation 
Unfair  to  rank  unlike  billets 
Not  enough  weight  given  to  narrative  evaluation 
by  selection  board 
Other 


10 

8 

8 

4 

4 

4 

3 

2 

10 


Total 


a  i,  *  /  IlSte,d  nfpe  Possible  methods  for  reducing  grade  inflation.  Respondents  were 
asked  to  (1)  mark  all  those  that  they  recommended  and  (2)  indicate  the  three  that  they 
most  recommended.  Table  9,  which  provides  results,  shows  that  46  percent  of  the 
respondents  recommended  putting  more  emphasis  on  the  narrative  section  of  the  FITREP 

offi°/JrcandK  GSS  T  6tter  °[  number  8rades;  and  40  percent,  limiting  the  percentage  of 
officers  who  can  be  put  m  the  topmost  grading  blocks. 

TK.cf1fy"SeVe+n  officers  listed  additional  recommendations  for  controlling  inflation. 
ZeSL™rentS  T.6re  collaPsed  lnt0  mne  categories,  which  appear  in  Table  10.  As  shown, 
mnniTor  tthIeqUrVy  r/?,cornmended  category  was  to  force  a  distribution  of  ratings  and 
Zllll  •  adherence  to  the  distributional  requirement  (N  =  16),  followed  by 

m^  rr+1na°KS  mcreasi?S  objectivity  (e.g.,  providing  better  definitions  of 

measures)  (N^-  10)  &  obtainment  sPecific  goals,  and  the  development  of  objective 
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Table  9 


Listed  Methods  for  Reducing  Grade  Inflation 


Method 

Marked  as 
Recommended 
(%) 

Marked  as  One 
of  Three  Most 
Recommended 
(%) 

Put  more  emphasis  on  narrative,  less 
on  letter/number  grades 

46 

42 

Limit  the  percentage  of  officers  who  can  be 
put  in  the  topmost  grading  blocks 

40 

40 

Eliminate  up-or-out  aspect  of  promotion 

37 

31 

Apply  corrections  to  scores  to  compensate  for 
the  harshness  or  leniency  of  a  given  rater 

40 

29 

Have  person  senior  to  rater  review  and  sign  report 

31 

19 

Put  more  emphasis  on  letter/number  grades,  less 
on  narrative 

21 

16 

Impose  penalties  on  raters  who  inflate 

19 

13 

Use  written  tests  to  supplement  the  FITREP 

21 

11 

Keep  FITREPs  secret 

19 

11 

Note.  A  conservative  standard  error  for  these  percentages  is  A  95 

percent  confidence  interval  is  ±  6  percentage  points. 


i 
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Table  10 


Methods  Suggested  by  Respondents  for  Reducing  Grade  Inflation 


Response  Categories 

Frequency 

Force  a  distribution  and  monitor  the  raters 

16 

Develop  objective  measures,  manage  by  results,  provide 
better  definition  of  each  mark 

10 

Educate  raters,  stress  honesty 

6 

Don't  require  the  top  rating  to  be  promoted 

6 

Try  a  new  system 

6 

Eliminate  ratings  and  rank  with  similar  personnel 

3 

Shorten  the  form 

3 

Develop  different  rating  scales  for  different  ranks 

2 

Other 

15 

Total 

67 

responses  to  item  12,  only  one  group  difference  was  statistically  significant 
l<  .05).  Twenty-five  percent  of  the  officers  with  much  FITREP  experience  in  their 
careers  (26+  written)  most  recommended  putting  more  emphasis  on  letter/number  grades 
and  less  on  the  narrative,  compared  to  7  and  10  percent  respectively  of  those  with  no  or 
some  experience.  This  finding  is  consistent  with  the  way  experience  influences  which 
system  characteristics  are  most  liked.  A  trend  (p  =  <  .08)  toward  group  differences  in 
attitudes  concerning  the  narrative  evaluation  is  also  consistent  with  other  results.  Thirty- 
seven  percent  of  officers  with  much  experience  in  writing  FITREPs  most  recommended 
putting  greater  emphasis  on  the  narrative  section,  compared  to  53  and  52  percent 
respectively  of  those  with  no  and  some  experience.  Finally,  25  percent  of  officers  with 
much  experience  recommended  eliminating  the  up-or-out  aspect  of  promotion,  compared 

+  Zk  an.^  .  P<Trcent  of  those  with  no  or  s°me  experience.  This  difference  was  significant 
at  the  .10  level.  In  general,  respondents  feel  that  the  problems  with  the  evaluation  form 
reside  not  so  much  in  the  form  itself,  but,  rather,  in  how  it  is  used  and  its  lack  of 


Counseling 

Items  13  through  16  addressed  the  counseling  function  of  the  evaluation  system.  In 
response  to  item  13,  which  asked  whether  the  respondent,  as  a  ratee,  had  been  criticized 
due  to  a  misunderstanding  of  the  exact  nature  and  priorities  of  his  or  her  duties,  80 
percent  responded  never  or  almost  never.  Understanding  one's  duties  does  not  seem  to  be 
regarded  as  a  problem.  In  response  to  item  14,  which  asked  if  the  respondent,  as  a  rater, 
had  been  critical  of  his/her  subordinates  for  not  understanding  their  duties,  62  percent 

pernmn+led  nCVer  °r  aI™St  neVer?  29.Percen?». infrequently;  and  9  percent,  frequently. 

.  ese  ffsPonses>  ^  appears  that  job  clarification  is  not  a  pressing  issue.  However, 
when  respondents  were  asked  whether  there  should  be  a  formal  procedure  for  clarifying 
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the  subordinate's  duties  (item  15),  over  80  percent  felt  that  there  should  be.  The  most 
likely  explanation  for  this  apparent  discrepancy  is  that  misunderstandings  do  occur,  but 
they  are  taken  in  stride  rather  than  as  grounds  for  criticism  of  subordinates. 

Finally,  item  16  asked  respondents  to  indicate,  on  a  scale  ranging  from  1  to  12 
months  before  the  next  FITREP  was  due,  when  formal  discussions  of  assignment  and 
periodic  performance  reviews  should  take  place.  Sixty-six  percent  said  that  assignment 
discussions  should  occur  12  months  before  the  FITREP,  and  42  percent  that  performance 
reviews  should  occur  6  months  before  the  FITREP.  Some  officers  inserted  comments 
stating  that  another  assignment  meeting  should  be  held  when  an  officer  departs  command, 
regardless  of  when  that  happens.  One  comment  was,  "The  FITREP  should  be  no  surprise 
to  any  officer,  but  quite  often  junior  officers  do  not  receive  timely  and  regular  feedback 
from  their  superiors." 

The  only  difference  among  groups  was  that  respondents  with  some  experience  in 
writing  FITREPs  (1-25)  were  more  likely  to  put  the  performance  review  at  6  months  than 
were  those  with  much  experience  (26+). 

Alternative  Evaluation  Systems 

Item  17  asked  respondents  to  indicate  whether  they  preferred  to  have  an  open  or  a 
closed  evaluation  system,  using  a  5-point  scale,  ranging  from  strongly  prefer  an  open 
system  to  strongly  prefer  a  closed  system.  A  closed  system  was  defined  as  one  where 
some  or  all  of  the  report  is  not  seen  by  the  ratee.  The  present  system  is  supposedly  open, 
but  some  respondents  noted  on  the  questionnaire  that  they  had  not  seen  a  FITREP  in 
several  years.  Seventy-eight  percent  indicated  they  strongly  preferred  an  open  system; 
and  14  percent,  that  they  preferred  it,  for  a  total  of  92  percent.  No  one  strongly 
preferred  a  closed  system,  even  though  some  officers  commented  that  a  closed  system 
would  probably  help  curb  grade  inflation. 

Item  18  asked  respondents  whether  they  favored  or  opposed  adding  a  section  to  the 
FITREP  to  measure  the  ratee's  perceived  potential  for  future  promotion.  While  this 
suggestion  was  not  as  heartily  endorsed  as  an  open  system,  it  was  also  strongly  favored. 
Forty-seven  percent  strongly  favored  a  section  on  ratee  potential  and  33  percent  favored 
it,  for  a  total  of  80  percent. 

Items  19  through  23  presented  five  alternative  rating  formats  and  asked  respondents 
to  rate  them  on  a  5-point  scale  ranging  from  very  satisfactory  to  very  unsatisfactory. 
Results,  presented  in  Table  11,  show  that  the  current  format,  Blocks  51  and  52  of  the 
FITREP,  was  most  highly  rated,  with  76  percent  of  the  respondents  rating  it  as 
satisfactory  or  very  satisfactory.  In  Block  51,  the  rater  rates  an  officer  on  a  9-point 
slotted  scale,  with  four  slots  in  the  high  category,  two  in  the  middle  category,  and  three 
in  the  low  category.  In  Block  52,  the  rater  enters  his  or  her  overall  distribution  of  ratings 
given  to  officers  of  the  same  rank  and  designator  within  the  current  rating  cycle. 

Item  24  asked  respondents  to  rank  order  the  five  options.  Although  an  alternative 
format,  called  "total  range  of  officer  value"  (item  20),  received  more  first  rankings  than 
did  the  current  format  (92  vs.  84),  the  means  of  the  rankings  (see  Table  11)  were  the 
same.  This  alternative  format  has  a  scale  that  runs  from  1  to  45,  which  is  intended  to 
represent  the  value  of  the  officer  being  rated  in  accomplishing  the  mission  of  the  Navy, 
compared  with  that  of  other  officers.  Each  rank  encompasses  10  points,  and  overlaps  the 
next  rank  by  3  points.  For  example,  the  designated  range  for  the  rank  of  ENS  is  from  1  to 
10,  while  that  for  LT3G  is  from  8  to  17.  Officers  may  be  rated  outside  the  designated 

for  their  rank  if  the  raters  substantiate  their  reasons  for  doing  so  in  writing. 
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Table  11 


Alternative  Evaluation  systems 


Rating  (Q19-23) 

Ranking  (Q24) 

Format 

Very  Sat.  or 
Sat.  (%) 

Undecided 

(%) 

Unsat.  or  very 
Unsat.  (%) 

X 

Current  Format 
(Blocks  51-52) 

76 

9 

15 

2.3 

Total  Range  of 
Officer  Value 

51 

25 

24 

2.3 

Distance  from 
Average 

45 

24 

30 

2.8 

Local 

Distribution 

47 

22 

31 

3.2 

Varying  Promo¬ 
tion  Rate 

37 

26 

38 

3.4 

In  items  20  through  24,  officers  were  asked  for  their  comments  on  the  four 
alternatives  to  the  current  format,  Blocks  51  and  52.  Table  12  provides  the  frequency 
distribution  of  comment  categories.  As  shown,  the  most  frequent  concerns  were  that  (1) 
even  if  the  alternative  formats  were  used,  there  would  still  be  grade  inflation  (N  =  111, 
24%),  and  (2)  the  alternatives  are  just  minor  word  variations  of  the  present  form  (N=  94, 
20%).  Officers  expressed  two  concerns  specific  to  the  most  popular  alternative,  "total 
range  of  officer  value":  (1)  the  substantiation  requirement  for  out-of-rank  scores  would 
cause  problems,  and  (2)  the  scale  does  not  provide  space  for  warrant  officers  or  limited 
duty  officers  (LDOs).  However,  respondents  also  made  a  variety  of  positive  comments 
about  this  format  (N  =  23).  There  were  no  differences  in  how  these  alternatives  were 
evaluated  by  rank,  officer  community,  regular/reserve  status,  gender,  or  experience  in 
writing  FITREPs. 

Self-appraisal 

Since  the  questionnaires  were  to  be  returned  anonymously,  officers  were  asked  to 
indicate,  on  a  scale  of  1  to  1000,  with  1000  representing  the  top  performer  and  500  the 
average,  where  (1)  they  would  rate  themselves  among  officers  of  their  rank,  (2)  they  felt 
the  Navy  (e.g.,  a  selection  board)  would  rate  them,  and  (3)  they  thought  the  supervisor 
who  completed  their  last  FITREP  would  rate  them  (items  25-27).  The  results  are  provided 
in  Table  13,  along  with  the  respondents'  last  FITREP  rating  (item  28).  (Appendix  D 
presents  graphs  of  the  distributions.)  As  shown,  the  highest  rating  is  the  supervisor  rating; 
given  the  current  inflation  in  FITREP  ratings,  this  is  probably  an  accurate  reflection  of 
supervisor  leniency.  The  self  rating  is  next,  followed  by  the  Navy  rating.  This  ordering 
seems  to  indicate  that  officers  (1)  recognize  that  their  supervisor's  ratings  are  inflated, 
(2)  feel  their  performance  is  outstanding  but  not  as  good  as  reflected  by  their  supervisor, 
and  (3)  the  Navy's  recognition  of  their  worth  is  high,  but  lower  than  they  deserve.  Half  of 
the  self-appraisal  ratings  were  900  or  better;  thus,  50  percent  of  the  officers  believe  that 
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Table  12 


Frequency  of  Comment  Categories  on  Proposed  Alternatives  to  Blocks  51  and  52 


Comment  Category 

Total 
Range 
(Q.  20) 

Distance 
from 
Average 
(Q.  21) 

Local 

Distribution 
(Q.  22) 

Varying 

Promotion 

Rate 

(Q.  23)  Total 

There  would  still  be 

46 

30 

12 

23 

111 

grade  inflation 

Minor  variation  of  the 

17 

5 

48 

24 

94 

present  or  prior  format 

Good;  miscellaneous 

23 

11 

13 

16 

63 

positive  comments 

Bad;  miscellaneous 

10 

15 

10 

21 

56 

negative  comments 

Too  subjective 

5 

8 

7 

10 

30 

Too  difficult;  confusing 

4 

5 

0 

10 

19 

Would  help  curb  inflation; 

13 

6 

0 

0 

19 

better  able  to 

differentiate 

Lacks  ranking  among  peers 

7 

3 

0 

0 

10 

Problems  with  definitions; 

8 

16 

6 

0 

30 

specificity  of  categories 

Substantiation  requirement 

7 

N/A 

N  A 

N/A 

7 

would  cause  problems 

Like  setting  standard 

N/A 

16 

N/A 

N/A 

16 

for  individual  rater 

Neutral  comments 

0 

6 

7 

0 

13 

Total 

140 

121 

103 

104 

468 

Table  13 

Self,  Navy,  Supervisor,  and  FITREP  Ratings 

Rating  N 

Mean 

Std.  Dev.  Minimum 

Maximum 

Self  294 

861 

124 

400 

1000 

Navy  290 

830 

158 

300 

1000 

Supervisor  292 

894 

128 

400 

1000 

Last  FITREP3  289 

1.2 

.36 

1 

2 

Last  FITREP  ratings  were  collapsed  into  2  categories:  2  if  the  highest  rating  was  given, 
and  1  otherwise. 
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the  Navy  should  evaluate  them  as  in  the  top  10  percent  of  officers.  As  discussed  on  p.  21, 
high  self-evaluations  are  a  rather  common  research  finding. 


Table  14  shows  that  the  intercorrelations  among  the  self,  Navy,  and  supervisor 
ratings  range  between  .54  and  .58,  a  relationship  that  is  lower  than  might  be  expected  if 
the  1  to  1000  scale  had  meaningful  anchor  points  for  the  officers.  As  expected,  supervisor 
ratings  correlated  higher  with  the  last  FITREP  rating  than  did  either  the  self  rating  or  the 
Navy  rating. 


Table  14 

Correlation  Coefficients  Between  Ratings 


Rating 

Self 

Navy 

Supervisor 

Last  FITREP 

Self 

— 

.58 

.54 

.35 

Navy 

Supervisor 

Last  FITREP 

.56 

.36 

.52 

Officer  Comments 


The  last  page  of  the  questionnaire  provided  space  for  comments.  Half  the 
respondents  chose  to  comment.  Table  15,  which  provides  the  frequencies  for  comment 
categories,  show  that  the  most  frequent  remark  was  that  the  present  evaluation  system  is 
satisfactory  (N  =  27)  with  no  qualifications.  The  most  laudatory  comment  was  "The 
present  system  is  effective.  There  is  room  to  give  all  that  is  required  to  meet  the  spirit 
and  intent."  Another  comment:  "The  present  system  is  very  good  if  used  properly." 

Again,  "The  forms  are  not  at  fault.  It  is  the  attitude  of  people  writing  FITREPs  that  need 
changing." 

*n  Edition,  13  officers  stated  that  the  possible  alternatives  to  the  present  sytem 
would  not  improve  the  evaluation  process.  The  most  frequent  negative  comment  was  that 
politics  and  personality  affect  evaluations  too  much  (N  =  9).  Another  area  of  concern 
related  to  the  time  consumed  in  preparing  the  FITREPs  (N  =  5). 


Officers  also  commented  on  their  experiences  with  the  present  evaluation  system. 

T-ueSf  ^xP®r^ences  illuminate  why  some  officers  are  disenchanted  with  the  system. 
The  following  six  quotes  illustrate  the  concerns. 


1.  It  is  a  well-known  fact  that  most  FITREPs  are  inflated  to  excess.  A  mediocre 
performer  is  two  blocks  to  the  left  if  he  is  board-eligible.  Consequently,  he  is  promoted 
as  a  below-average  performer  and  remains  below  average.  It  is  difficult  to  sell  a  low 
mark  on  an  otherwise  excellent  performer  whether  officer  or  enlisted.  As  (an)  individual 
progresses  up  the  chain,  he  is  comfortable  in  his  belief  that  he  has  always  been  marked 
high  in  each  trait.  Now  he  becomes  a  department  head  and  is  a  poor  leader  or 
administrator  and  in  some  cases  both. 
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Table  15 


Frequency  of  Comment  Categories 


Comment  Category  Frequency 


System  in  General 


Positive  Comments; 

Present  system  is  OK— no  elaboration  27 

The  possible  alternatives  would  not  help  13 

(e.g.,  reduce  inflation,  increase  fairness) 

The  best  people  get  promoted  4 

When  the  system  is  changed,  the  transition  hurts  officers;  4 

stop  changing  the  system 

Negative  Comments: 

Politics  and  personality  affect  evaluations  too  much  9 

Present  system  is  a  problem— no  elaboration  7 

Bad  experiences  with  the  present  system  6 

Inflation  is  tough  to  eliminate;  human  nature;  the  system  5 

is  not  likely  to  improve 

FITREPs  are  time-consuming;  reduce  or  do  not  increase  time;  make  5 

simple  as  possible;  reduce  paperwork;  OCR  format  is  a  pain 
Officer  speciality-specific  problem  4 

The  best  do  not  get  promoted  2 

Do  not  let  one  bad  FITREP  affect  career  2 

The  system  doesn’t  distinguish  among  performance  quality  2 

Concentrate  on  improving  fairness  and  objectivity  2 

44 


Problem  Areas/Recommendations  for  FITREP 


Rater  Characteristics: 

Educate  raters,  COs,  ratees,  etc.  6 

Rater  needs  to  be  honest;  "tell  it  like  it  is"  6 

Have  prior  history  of  rating  influence  rating;  compare  to  5 

Navy  standard 

Have  someone  quality  control  FITREP  (e.g.,  senior’s  senior,  4 

review  board) 

Lacks  qualifications  (e.g.,  passed  over  for  promotion)  3 

Hardnosed  or  "honest"  2 

Have  raters  evaluated  on  how  effectively  they  write  FITREPs  2 

Some  raters  have  limited  exposure  to  ratees  1 

29 

Ratings: 

Define  terms  more  precisely;  provide  a  standard  average  1 1 

Ratings  are  inflated  because  rater  does  not  want  to  hurt  career  11 

Ensure  bell-shaped  curve;  force  distribution  7 

Ratings  are  inflated  because  rater  does  not  want  to  hurt  person  4 

(in  open  evaluation  system)  - 

33 

Rankings: 

Unfair  due  to  comparison  group  11 

Statement  of  who  the  comparison  group  should  include  1 1 

Very  important  f  7 

Eliminate  rankings  4 

Affected  by  perceived  value  of  the  billet  1 

34 
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Table  15  (continued) 


Comment  Category  Frequency 


Problem  Areas/Recommendations  for  FITREP  (Continued) 


Narrative: 

Cite/stress  actual  achievement;  weight  each  achievement  9 

Too  influenced  by  word  choice  5 

Prefer  more  marks,  less  writing;  standardize/objectify  4 

Objectivity;  format  (e.g.,  bullets;  short  sentences;  lists)  4 

Very  important  2 

24 

Counseling/Feedback: 

More  frequent;  very  important  7 

Have  ratee  state  his  goals;  rate  himself;  provide  input  3 

Open  system  needed;  ensure  signature  of  ratee  on  FITREP  2 

Do  not  formalize  1 

FITREP  syould  be  privileged  document  between  rater  and  ratee  1 

Have  immediate  superior  brief  FITREP  as  well  as  CO  1 

Separate  counseling  and  promotion  process  1 

16 

Recommendations  for  Formats  or  Sections: 

A  specific  suggested  format  9 

No  FITREP  except  for  very  top  and  bottom  performers  3 

All  narrative  FITREP  3 

Additional  attributes  should  be  considered  3 

(e.g.,  potential) 

Accelerated  promotion  block  is  a  problem  1 

Blocks  62-65  should  be  eliminated  1 

20 

Other: 

Look  at  other  military  evaluation  systems  7 

Comments  on  this  questionnaire  4 

Ambiguous/confusing  comment;  not  understood  2 

Self-appraisal  won’t  work  2 

Up-or-out  should  be  eliminated  1 

Officer  should  be  given  option  of  NOT  being  considered  for  1 

promotion  wihtout  being  considered  a  passover 
Selection  boards  need  to  spend  more  time  evaluating  each  officer  1 

One  of  two  recommended  for  are  awarded  promotion  1 

Get  rid  of  nonperformers  1 

Total  20 


Overall  total  26S 
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2.  My  college  GPA  was  utilized  as  the  primary  determinant  for  my  initial  linear 
number/year  group  standing.  I  have  been  in  the  rear  of  my  year  group  every  since, 
regardless  of  my  excellent  FITREPs  and  the  board  billets  I've  filled.  The  fact  that  an 
individual's  annual  performance  grades  could  immediately  affect  one's  relative  seniority 
vis-a-vis  selection  board  windows  could  radically  alter  the  effort  exerted  by  officers 
toward  their  jobs.  (As  to)  Relative  rankings  inside  a  wardroom  or  office,  I  am  in 
competition  with  men,  aboard  my  current  ship,  who  are  all  top  performers.  The  bottom 
man  will  be  sacrificed,  irregardless  (sic)  of  the  fact  that  he  is  better  than  most  others  of 
his  rank  in  the  fleet.  The  rank  and  experience  of  my  current  CO  might  save  the  bottom 
LCDR  or  LT,  but  the  next  CO  might  not  care  enough  to  try  (and  the  odds  are  he  won't). 

3.  For  14  straight  years,  I  have  had  1  percent  accelerated  promotion  FITREPs 
(except  while  in  school).  Plus  last  one  was  1  percent  regular  promotion.  The  way  the 
system  now  works  that  is  enough  to  probably  deny  me  a  chance  at  flag  rank.  This  is  a  B  in 
my  system.  While  a  B  would  not  change  the  end  result,  it  would  be  more  representative  of 
what  grading  seniors  want  to  say;  that  is,  I  am  not  sure  I  want  to  see  this  guy  an  admiral. 

4.  In  1978,  with  the  new  FITREPs,  I  was  evaluated  by  a  LCDR  who  went  exactly  by 
the  form;  that  is,  I  received  some  30  percent  and  50  percent  marks.  As  a  result,  I  have 
not  been  able  to  get  sea  duty  billets.  Subsequent  evaluations  have  been  top  1  percent 
early  promotion,  at  three  different  duty  stations.  I  therefore  think  that  a  correction 
factor  is  needed  to  apply  based  upon  the  evaluating  senior's  mean  rating.  Many  other 
junior  officers  assigned  to  this  officer  have  also  been  hurt  by  his  lack  of  inflation. 

5.  Under  the  current  system,  the  only  thing  a  FITREP  can  do  is  hurt  you.  If  you 
receive  a  perfect  FITREP,  then  you  are  on  an  equal  footing  with  the  bulk  of  the  officer 
community.  If,  however,  your  reporting  superior  gives  you  an  honest  evaluation  based  on 
what  each  block  of  the  FITREP  says,  then  you  are  behind  the  power  curve.  I  was  told  by 
my  CO  at  SWOS  that,  if  you  don't  get  a  perfect  FITREP  every  time,  forget  it.  If  you  do, 
then  look  at  things  like  the  dates  and  spelling  because  they're  the  only  differences  which 
can  be  used  to  judge  FITREPs.  Now,  to  me,  this  is  the  height  of  ridiculousness  and 
renders  the  entire  system  invalid. 

6.  The  system  has  been  most  abused  by  senior  officers  06  and  above.  The  system 
has  been  abused  by  most  every  officer  I've  seen  for  19  years.  The  standard  comment  is 
the  senior-most  ratee  in  that  grade  gets  the  best  mark  or,  if  a  man  is  up  for  board,  he  gets 
the  highest  marks.  That  only  promotes  the  Peter  Principal.  I've  heard  that  last  statement 
for  the  past  10  years  in  every  unit  I've  been  in. 

The  two  primary  recommendations  given  by  the  respondents  for  ensuring  that  forms 
are  used  appropriately  were  to: 

1.  Provide  more  specific  definitions  of  the  performance  standards;  cite  and  stress 
actual  achievements.  Example  comments:  "Specific  aspects  of  performance  and  personal 
trait  sections  need  to  be  clarified."  "Information  should  be  promulgated  via  the  basic 
instructions  as  to  the  marks  considered  to  be  average,  above  average,  etc." 

2.  Provide  more  training  to  raters.  Example  comment:  "All  XOs/COs  should  be 
required  to  receive  a  briefing  on  what  the  current  command  selection  boards  are  looking 
for  in  officers'  FITREPs." 
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Ratings  are  inflated  because  the  rating  senior  does  not  want  to  impede  the  career  of 
his  junior  (N  =  1 1 ).  As  long  as  a  less-than-top  rating  can  block  promotion,  a  senior  will  be 
hesitant  to  give  less  than  a  top  mark  to  any  but  the  very  poor  officers. 


DISCUSSION  AND  CONCLUSIONS 

Officers  responding  to  the  questionnaire  were  fairly  unanimous  and  consistent  in  what 
they  liked  and  disliked  about  the  present  evaluation  system.  Recommended  additions  to 
the  current  form  include  a  section  on  potential,  a  formal  procedure  for  clarifying  assigned 
duties,  more  detailed  and  specific  definitions  of  the  evaluation  categories  and  perfor¬ 
mance  standards,  and  a  more  structured  narrative  section.  Yet,  the  alternative  formats 
for  Blocks  51  and  52  either  were  not  understood  or  were  not  perceived  as  improvements, 
since  no  alternative  was  preferred  over  the  current  format.  Only  the  "total  range  of 
officer  value"  scale  was  rated  hightly  enough  to  justify  further  evaluation.  The  ultimate 
usefulness  of  any  new  rating  scale  would  have  to  be  empirically  determined. 

From  the  write-in  comments,  one  can  conclude  that  the  form  used  for  FITREPs  is  not 
the  critical  concern.  This  finding  is  similar  to  the  conclusion  drawn  by  Lawler,  Mohrman, 
and  Resnick  (1983): 

Our  data  strongly  suggest  that  the  answer  to  doing  a  performance 
appraisal  well  is  in  focusing  on  the  process  of  the  appraisal  and  on  the 
organizational  context  in  which  the  event  takes  place.  This  recom¬ 
mendation  is  in  direct  contrast  to  the  emphasis  that  is  usually  placed 
on  the  form.  (p.  21) 

Grade  Inflation 


How  much  of  a  problem  grade  inflation  presents  depends  on  how  the  FITREP  is  used. 
The  primary  use  of  the  FITREP  is  selection  for  promotion.  For  this  purpose,  inflation  is 
not  a  problem  at  lower  ranks  where  most  people  are  promoted  and  the  FITREP  scores  are 
less  inflated.  With  an  increase  in  rank,  the  percentage  of  personnel  getting  promoted 
decreases  while  the  average  FITREP  score  increases.  When  more  people  are  rated  in  the 
top  category  than  can  be  promoted,  then  other  information  must,  of  necessity,  be 
considered.  Lacking  discriminating  objective  information,  the  "other"  information  may 
well  be  the  choice  of  words  in  the  narrative  section,  previous  duty  assignments,  or  other 
factors. 

One  prime  reason  why  the  FITREP  scores  are  so  inflated  is  the  up-or-out  policy.  An 
officer  twice  passed  over  for  promotion  faces  mandatory  retirement.  Up-or-out  systems 
generate  inflationary  pressure  on  evaluations  by  tying  performance  ratings  to  professional 
survival.  Dunne  (1977)  reviewed  foreign  officer  evaluation  systems  and  found  that  "seven 
out  of  nine  that  operate  without  an  'up-or-out*  policy  indicate  an  ability  to  control 
inflation."  (p.  15)  Similarily,  the  U.S.  Coast  Guard  had  a  relatively  inflation-free  system 
until  an  up-or-out  policy  was  adopted~the  aftermath  was  almost  instant  inflation.  The 
U.S.  Civil  Service  has  no  up-or-out  and  very  little  inflation  (Tate,  1978).  In  the  Navy, 
superiors  may  not  feel  that  officers  they  are  rating  have  demonstrated  the  highest  levels 
of  performance  but  do  not  want  to  be  responsible  for  wrecking  subordinates'  careers. 

Up-or-out  systems  are  generally  born  of  need.  In  World  War  II,  the  Army  found  it 
necessary  to  abandon  a  150-year-old  policy  of  promotion  by  seniority  because,  as  noted  by 
General  Eisenhower,  senior  officers  "had  to  be  replaced  and  gotten  out  of  the  way  and 
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younger  men  had  to  come  along  and  take  over  the  job"  (quoted  by  Harris,  1981).  Although 
the  prospects  for  eliminating  the  up-or-out  system  may  be  negligible  at  present,  its 
probable  role  in  the  inflation  plaguing  military  evaluations  should  be  acknowledged.  One 
of  the  respondents  provided  the  interesting  suggestion  that  officers  should  be  given  the 
option  of  not  being  considered  for  promotion  without  being  considered  a  passover.  This 
option  would  seem  to  circumvent  the  up-or-out  system. 

In  addition  to  promotions,  FITREPs  are  also  used  to  select  for  commands  and  billets. 
Detailers  use  the  data  from  Blocks  51  and  52  and  the  recommendation  for  early  promotion 
in  assigning  officers  (Morrison,  Martinez,  <5c  Townsend,  1984).  However,  detailers 
anticipate  promotion  boards  by  placing  quality  people  in  career-required  positions.  Thus, 
detailing  seems  to  be  a  preliminary  promotion  decision,  laying  the  groundwork  for  career 
advancement. 

The  use  of  the  FITREPs  in  promotion  and  assignment  is  required  to  meet  the 
administrative  needs  of  the  service.  Immediate  uses  within  the  organizational  unit  (e.g., 
to  ensure  high  productivity,  to  identify  strengths  and  weaknesses,  to  set  goals,  etc.)  are 
not  affected  as  much  by  the  grade  inflation  noted  in  Blocks  51  and  52  because  global 
ratings  are  less  useful  for  counseling  the  ratee. 

The  nature  of  promotion  decisions  is  quite  dissimilar  to  that  of  counseling.  Counsel¬ 
ing  requires  data  reflecting  achievement  of  both  day-to-day  duties  and  long-range  goals 
and  is  little  affected  by  comparison  with  other  officers.  Promotion  is,  by  necessity, 
comparative,  and  the  attributes  on  which  officers  are  compared  must  apply  across  the 
diverse  roles  that  they  fill.  It  may  be  an  unacceptable  compromise  to  try  to  fill  both 
needs  with  one  process  and  form.  On  the  other  hand,  if  two  forms  were  used,  they  must 
be  compatible  or  officers  could  receive  contradictory  feedback.  However,  where 
promotion  is,  at  present,  inexorably  tied  to  up-or-out,  the  counseling  process  could  be 
separated  from  this  biasing  factor.  If  counseling  were  to  be  done  separately,  contingen¬ 
cies  would  have  to  be  applied  to  ensure  that  raters  take  the  time  to  perform  the  task.  For 
example,  raters  might  have  their  own  evaluations  designed  to  reflect  how  well  they 
counsel  their  staff. 

Open  Versus  Closed  Evaluation  Systems 

The  officers  participating  in  this  survey  perceived  an  open  system  as  very  desirable. 
The  present  system  is  designed  to  be  open,  with  the  ratee's  signature  required  on  the 
FITREP  form.  However,  there  are  other  aspects  to  an  open  system  besides  just  knowing 
what  marks  one  has  received.  Officers  need  to  be  informed  about  how  the  data  are 
interpreted,  what  decisions  are  based  on  the  results,  and  what  data  are  used  in  making  the 
decisions.  They  need  to  know  who  used  which  pieces  of  information  for  what  purposes. 
Without  objective  knowledge,  hearsay  and  myths  tend  to  determine  how  the  evaluation 
system  is  preceived— a  perception  that  may  be  less  favorable  than  the  system  deserves. 

Self-appraisals 

In  the  present  survey,  self-appraisals  were  gathered  as  a  matter  of  interest  rather 
than  as  a  plausible  means  of  performance  evaluation.  However,  the  use  of  self-appraisals 
in  rating  ability  and  work  performance  has  its  advocates  (e.g.,  Levine,  1978).  Most 
research,  however,  indicates  that  such  evaluations  are  inaccurate  (e.g.,  DeNisi  &  Shaw, 
1977;  Svenson,  1981;  Larwood  &  Whittaker,  1977).  Thornton  (1980),  after  reviewing  the 
literature,  concluded  that  self-appraisals  of  job  performance  show  more  leniency,  less 
variability,  and  less  discriminant  validity  than  do  appraisals  by  supervisors  and  peers. 
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Mabe  and  West  (1982),  in  a  review  of  52  studies,  found  a  mean  validity  coefficient  of  only 
.29  when  self-evaluations  were  compared  with  measures  of  work  performance. 

Self-enhancement  seems  to  be  one  source  of  inaccuracy.  A  study  at  General  Electric 
found  that  the  average  employee's  self-estimate  placed  him  at  the  77th  percentile 
(Thompson  &  Dalton,  1977).  Only  2  out  of  92  employees  rated  their  performance  below 
average.  In  the  current  survey,  55  percent  of  the  officers  rated  themselves  above  the 
90th  percentile.  While  the  source  of  such  bias  remains  fertile  ground  for  investigation 
(Zuckerman,  1979),  it  appears  that  self-appraisals  would  certainly  not  reduce  grade 
inflation. 


RECOMMENDATIONS 

Based  on  the  results  of  this  effort  and  those  noted  in  Larson  and  Rimland  (1984),  it  is 
recommended  that  the  Navy's  FITREP  system  be  modified  as  follows: 

1.  Implement  a  beginning-of-year  assignment  conference  and  midyear  assignment 
review  conference  between  the  ratee  and  the  reporting  senior,  to  be  held  12  and  6  months 
prior  to  the  FITREP  completion  date.  These  interviews  are  intended  to  ensure  mutual  and 
clear  understanding  of  the  subordinate's  duties  and  priorities.  While  such  circumstances 
as  change  of  command  or  reassignment  of  an  officer  may  require  some  reschedulings,  this 
could  easily  be  be  provided  for  in  implementing  instructions.  A  proposed  assignment 
conference  form  appears  in  Appendix  A,  Figure  A-3. 

2.  Revise  the  appraisal  worksheet  by  providing  expanded  definitions  of  the  traits. 

3.  Revise  the  current  FITREP  form  by  (a)  reducing  space  for  the  narrative,  (b) 
requiring  that  the  narrative  describe  specific  accomplishments,  (c)  implementing  an 
"evaluation  of  potential"  section,  (d)  deleting  Blocks  53-56  and  77-79  ("trend  of  perfor¬ 
mance"  and  "weaknesses  discussed"),  and  (e)  including  the  "total  range  of  officer  value" 
scale  on  an  experimental  basis. 

4.  Develop  rater  profiles  for  the  "evaluation  of  potential"  section,  with  a  feedback 

and  enforcement  mechanism  for  dealing  with  flagrant  inflators.  . 

5.  Introduce  all  changes  with  a  significant  educational  campaign,  beginning  several 
months  prior  to  actual  system  changes. 

6.  Initiate  preliminary  research  directed  toward  developing  an  interactive  computer 
graphics  system  that  would  enable  selection  boards  to  make  on-line  inquires  of  a  data  base 
consisting  of  all  FITREP  data  for  ratees. 

7.  Make  more  use  of  provisions  in  the  recently  enacted  Defense  Officer  Personnel 
Management  Act  (DOPMA)  enabling  selective  waiver  of  the  up-or-out  system.  These 
provisions  should  be  broadened  to  permit  a  larger  range  of  exceptions  to  up-or-out.  Such 
policy  modifications  will  become  increasingly  important  as  large  numbers  of  officers 
become  involved  in  narrow  but  vitally  important  areas  of  specialization  (e.g.,  computer 
technology). 
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t  INSURES  COMPLIANCE  WfTM  APPLICASLE  CIV  ILIAN  PERSONNEL 
REGULATIONS. 

MOTE  FOR  COMMANDERS  COMMANDING  OFFICERS  ANO  OFFICERS- 
IN-CHARGE.  THE  FOLLOWING  CONSIOER  AT  IONS  IN  ADO  IT  ON  TO  THE 
ABOVE  WILL  BE  MADE  AS  APPROPRIATE 

F.  INSPIRES  POSITIVE  NAVY  IMAGE  IN  BOTH  MILITARY  ANO 
CIVIUAN  ENVIRONMENTS. 

O.  DEMONSTRATES  AWARENESS  OF  ORGANIZATONA  L 

RELATIONSHIP*  SEYONO  THE  IMMEDIATE  CHAIN  OF  COMMAND 

H.  GIVES  POSITIVE  SUPPORT  TO  DECISION*  OF  HIGHER  AUTHORITY. 


„  JTRKSSFUL  STTUATON* 

^  RECOGNIZES  POTENTIAL  HAZARDS 

S  RETAINS  COMPOSURE  ANO  EFFECTIVENESS 
C  ACTS  WITH  TENACITY  THAT  OVERCOMES  DISCOURAGE MENT. 

D.  ACTS  DECISIVELY 
t  TAKES  EFFECTIVE  ACTION. 

MOTE  FOR  COMMANDERS.  COMMANCHNG  OFFICERS  ANO  OFFOIRS- 

INCHARGE.  the  FOLLOWING  CONSIDER  ATIONS  IN  ADOPTION  TO  THE 
ABOVE  WILL  SE  MADE  AS  APPROPRIATE. 
f  INSTILLS  CONFIDENCE  AMONG  SUBORDINATES, 
a  TAKES  TIMELY  AND  INNOVATIVE  ACTION*. 

K  EFFECTIVELY  PRIORITIZE*  RESPONSES  TO  MULTIPLE 

CONTINGENCIES. 


solull  OPPORTLwrrr 

A.  TAKES  EFFECTIVE  ACTION  TO  INCREASE  ONE'S  OPR!  RACIAL 

AWARENESS  AND  THAT  of  SUBORDINATES 
A.  INITIATES  ACTION  IH  SUPPORTING  THE  NAVY'S  EOUAL 
OPPORTUNITY  GOALS.  PROGRAMS  ANO  DIRECTIVES. 
INCLUDING  THE  COMMAND'S  AFFIRMATIVE  ACTION 
PLAN 

C  CONSIDERS  MINORITY  GROlWS  IN  PLANNING  ANO 

MAPLE  ME  NT  AT  ION  OF  PERSONNEL  ACTIONS 
D.  ACTIVE L V  SEEKS  TO  ELIMINATE  RACISM  ANO  SEXISM 

IN  THE  ORGANIZATION  _ 

ENSUR  El  EQUAL  OPPORTUNITY  TO  ALL  IN  MIRING.  TRAINING. 
DEVELOPING  AMO  PROMOTING  EI^LOYIES.  WITH  PROPER 
ATTENTION  TO  AFFIRMATIVE  ACTION  GOALS 
NOTE:  FOR  COMM  ANDERS.  COMMANDING  OFFICERS 
AMO  OFFICERS- INCH ARCE,  THE  FOLLOWING  CON 
S4DERATIONS  IN  AOOrriON  TO  THE  ABOVE  WILL  BE  MADE 
AS  APPROPRIATE 

f  ACTIVELY  SUPPORTS  EOUAL  OPPORTUNITY  PROGRAM* 

G.  HAS  DEVELOPED  OR  MAINTAINED  EFFECTIVE  TRAINING 
PROGRAMS  WHICH  HAVE  RESULTEO  in  a  HIGH  level 
OF  PERSONNEL  ACTIONS 

K  HAS  DETAILED  KNOWLEDGE  OF  THE  EQUAL  OPPORTUNITY 

ENVIRONMENT  WITHIN  THEIR  UNrTtSI  AS  A  RESULT  OF  CON 
TlHOOUS  COMMUNICATION  WITH  ALL  LEVELS  OF 
COMMAND 

t  EFFECTIVELY  ACMII  Vl*  AFFIRMATIVE  ACTION  GOALS 
WTTH  IN  RESOURCE /PR  OR  ITT  ALLOCATIONS 
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ASSIGNMENT  CONFERENCE  FORM 
PART  I.  TO  BE  FORWARDED  WITH  THE  OFFICER  FITNESS  REPORT 


1.  Name  (First,  Last,  MI) 

2.  Grade 

3.  Design. 

4.  SSN 

5.  ACDUTRA/TEMAC 

6.  UIC 

7.  Ship/Station  8. 

Date  Reported 

9.  To  be  jointly  completed  by  senior  and  subordinate  officers.  List,  as  specifically  as 
possible  and  in  order  of  priority,  the  duties  and  responsibilities  of  the  subordinate 
officer. 


10.  Signature  of  subordinate  officer:  11.  Signature  of  reporting  senior: 

"I  understand  that  the  above  duties 
constitute  a  major  part  of  my  task." 


Date 


Date 


MIDTERM  REVIEW  -  to  be  conducted  midway  through  the  rating  period.  If  revision  of  the 
duties  specified  in  section  9  is  necessary,  write  "REVISED"  in  bold  letters  across  this 
form,  fill  out  a  new  form,  and  attach  the  new  form  to  the  back  of  this  form. 

12.  Signature  of  subordinate  officer:  13.  Signature  of  reporting 

"I  certify  that  I  have  been  counselled  senior: 

concerning  my  accomplishment  of  duties 
to  date." 


Date  Date 

Figure  A-3.  Proposed  assignment  conference  form. 
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PART  II.  TO  BE  RETAINED  BY 
THE  REPORTING  SENIOR.  NOT  TO 
ACCOMPANY  THE  FITNESS  REPORT 


1.  To  be  completed  by  the  rated  officer.  List  on  this  form  your  accomplishments  during 
the  rating  period,  and  arrange  to  meet  with  your  senior  officer  several  weeks  before 
the  end  of  the  rating  period  to  review  your  performance.  Submit  this  document  at 
that  time. 


Signature  of  rated  officer 


Date 


Figure  A-3.  (Continued). 
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APPENDIX  B 

SUMMARY  OF  OFFICER  PERFORMANCE  EVALUATION  SYSTEMS: 
LESSONS  LEARNED  FROM  EXPERIENCE  (NPRDC  TR  85-6) 
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SUMMARY  OF  OFFICER  PERFORMANCE  EVALUATION  SYSTEMS: 

LESSONS  LEARNED  FROM  EXPERIENCE  (NPRDC  TR  85-6) 

Despite  the  time  and  attention  devoted  to  the  task  of  providing  fair,  objective,  and 
administrative  usable  assessments  of  officers,  it  is  widely  acknowledged  that  the  officer 
appraisal  systems  leave  much  to  be  desired.  Rating  inflation,  the  systematic  practice  of 
assigning  ratings  higher  than  those  deserved,  is  the  most  serious  source  of  error  in 
performance  appraisal.  The  major  reasons  for  inflation  are  considered  to  be: 

1.  Reluctance  to  impair  the  motivation  of  subordinates. 

2.  The  supposition  that  overall  competency  in  the  officer  corps  may  currently  be 
higher  than  in  the  past. 

3.  The  opinion  that  one's  own  subordinates  are  better  than  average. 

4.  Unwillingness  to  sacrifice  a  subordinate  to  the  "up-or-out"  promotion  policy. 

5.  Concern  that  leniency  on  the  part  of  other  raters  will  put  one's  own  subordinates 
at  a  disadvantage. 

6.  Desire  to  enhance  group  cohesion. 

7.  Recognition  that  rewards  are  severely  limited  in  a  military  environment. 

A  great  many  methods  have  been  applied  in  the  effort  to  curb  inflation.  All  have 
been  failures,  some  spectacularly  so,  largely  because  they  either  created  confusion  or 
mandated  complicance  with  rigid  standards  that  resulted  in  large  numbers  of  officers 
receiving  ratings  below  their  expectations.  Among  the  more  noteworthy  failures  was  the 
Army's  forced-choice  system  (1947-1950),  which  was  also  briefly  used  by  the  Air  Force. 
The  forced-choice  procedure  required  the  rater  to  evaluate  the  ratee  by  choosing,  from 
sets  of  four  words  or  phrases,  the  two  words  or  phrases  most  descriptive  of  the  ratee.  As 
a  hypothetical  example  of  a  forced-choice  item: 

Select  the  two  choices  that  (a)  Bold 

best  describe  the  ratee.  (b)  Ingenious 

(c)  Honest 

(d)  Dependable 

Previous  research,  based  on  data  from  over  50,000  subjects,  had  determined  that  two 
descriptors  (say  (a)  and  (d))  tended  to  be  applied  to  superior  officers,  while  the  other  two 
((b)  and  (c))  tended  to  be  applied  to  average  officers.  The  rater,  not  knowing  the  scoring 
key,  was  expected  to  give  unbiased,  objective  ratings,  thereby  reducing  inflation.  Despite 
the  sophistication  of  this  methodology,  it  proved  to  be  so  unpopular  that  it  had  to  be 
abandoned. 

A  similar  example  of  a  technologically  sophisticated  system  that  proved  to  be 
unacceptable  to  the  ratees  was  the  Air  Force's  controlled  rating  format  (1974  to  1978). 
This  format  permitted  only  22  percent  of  the  officers  to  receive  a  top  rating  of  "1,"  and 
only  50  percent,  a  "1"  or  "2."  Unfortunately,  the  false  perception  arose  among  the 
remaining  50  percent  of  officers  that  their  future  opportunities  for  promotion,  and  their 
careers,  were  in  jeapordy.  This  belief  was  so  pervasive  that  the  Air  Force  finally 
abandoned  the  system.  As  with  the  Army's  forced-choice  format,  the  designers  of  the  Air 
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Force's  controlled  rating  systems  had  underestimated  the  human  element— officers  are 
people,  too. 

While  other  techniques  (e.g.,  the  use  of  endorsers,  multiple  raters,  and  anonymous  or 
confidential  raters)  have  been  considered  and  sometimes  tried,  none  appear  to  represent  a 
satisfactory  answer.  The  continued  pursuit  of  better  rating  formats,  particularly  as 
embodied  in  the  use  of  behaviorally  anchored  rating  scales  (BARS),  has  also  shown  little 
promise  for  halting  inflation.  While  the  use  of  objective  performance  terminology  rather 
than  personality  trait  terminology  does  seem  to  be  useful  and  should  be  encouraged  in  the 
design  and  completion  of  forms,  the  outcome  of  a  good  deal  of  BARS  research  is  equivocal 
at  best,  and  the  BARS  approach  is  not  thought  to  be  cost-effective. 

At  present,  the  only  promising  solution  to  halting  inflation  appears  to  be  "rating  the 
rater,"  which  refers  to  the  use  of  statistical  methods  to  correct  or  adjust  ratings  to 
compensate  for  excessively  inflationary  ratings,  on  an  individual  basis.  Variations  on  this 
idea  are  currently  employed  by  the  Army  and  Coast  Guard  and,  if  properly  implemented, 
may  also  be  of  use  in  Navy  performance  evaluations. 

No  discussion  of  officer  evaluations  would  be  complete  without  acknowledging  the 
overriding  influence  of  the  "up-or-out"  system.  "Up-or-out"  is  obviously  a  major  cause  of 
inflation.  The  Defense  Officer  Personnel  Management  Act  (DOPMA)  of  1981  has  recently 
provided  for  limted  suspension  of  "up-or-out."  Since  officers  who  have  trained  intensively 
in  a  specialty,  such  as  computer  technology,  may  be  at  a  disadvantage  when  competing  for 
promotion  with  their  broadly  experienced  counterparts,  the  selective  suspension  of  "up-or- 
out"  may  relieve  some  of  the  inflationary  pressures  on  the  FITREP  system,  as  well  as 
permit  the  Navy  to  retain  some  of  the  specialists  who  will  become  increasingly  important 
to  the  Navy's  capability  for  fulfilling  its  mission  in  the  years  to  come. 

Ther  Performance  Appraisal  Interview 

The  performance  appraisal  interview  is  an  important  component  of  the  performance 
evaluation  system.  Like  the  inflation  problem  in  evaluation,  the  appraisal  interview  is 
beset  with  technical  and  "human"  problems  that  are  difficult  to  surmount,  or  even  avoid. 

Among  the  various  approaches  toward  improving  the  performance  counseling  pr-ocess 
is  the  management  by  objective  (MBO)  approach,  which,  if  it  worked  as  advertised,  would 
provide  an  important  improvement  to  performance  evaluation  as  well.  MBO  provides  a 
systematized  procedure  for  evaluating  performance  by  comparing  it  with  established 
goals.  The  Marine  Corps,  Coast  Guard,  and  the  Army  currently  employ  MBO-type 
methods  as  part  of  their  appraisal  system. 

MBO  has  become  very  popular,  both  as  a  management  technique  and  as  a  subject  of 
research.  Unfortunately,  the  latter  does  not  support  the  former.  One  researcher,  after 
analyzing  185  studies  of  MBO,  noted  that  the  research  findings  do  not  provide  nearly  as 
much  support  for  MBO  as  do  the  case  study  reports,  which  are  biased  in  favor  of  positive 
findings. 

Among  the  criticisms  that  have  been  leveled  at  MBO,  the  most  serious  appear  to  be 
that  (1)  MBO  tends  to  narrow  the  range  of  activities  on  which  performance  may  be  judged, 
without  providing  for  the  unpredicted,  and  (2)  it  requires  excessive  time  and  paperwork. 

Although  MBO  may  be  too  rigid  for  many  applications,  the  concept  of  goal-setting  is 
readily  acknowledged  to  be  important.  If  the  Navy  officer  performance  system  is  to  be 
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improved,  some  form  of  performance  counseling/mutual  goal-setting  seems  to  be  neces¬ 
sary.  The  survey  of  fleet  officers,  described  in  NPRDC  TR  85-6,  provides  support  for  the 
performance  interview  concept  and  helps  clarify  the  optimal  context  and  procedure  for 
encouraging  productive  superior-subordinate  assignment-setting  and  performance  counsel¬ 
ing.  Strong  support  was  provided  for  a  mid-year  assignment  counseling  interview  in  which 
the  superior  and  subordinate  can  clarify  the  subordinate's  understanding  of  his  or  her 
priorities. 

*******************  *******  ******  *************************** 

The  foregoing  is  a  highly  abbreviated  overview  of  the  fully  referenced  and 
documented  report  "Officer  Performance  Evaluation  Systems:  Lessons  Learned  from 
Experience"  (NPRDC  TR  85-6).  Readers  interested  in  further  information  on  the  topics 
discussed  above,  as  well  as  related  matters,  are  urged  to  read  the  technical  report  itself. 
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APPENDIX  C 


OFFICER  EVALUATION  SYSTEM  QUESTIONNAIRE 
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15  August  1983 


NAVY  PERSONNEL  RESEARCH  AND  DEVELOPMENT  CENTER 
SAN  DIEGO,  CALIFORNIA  92152 


OFFICER  EVALUATION  SYSTEM 
QUESTIONNAIRE 


The  Navy  Personnel  Research  and  Development  Center,  San  Diego,  is  con¬ 
ducting  research  designed  to  improve  the  performance  appraisal  system 
and  the  officer  fitness  report. 

You  are  asked  to  participate  in  this  research  by  completing  this  ques¬ 
tionnaire.  Participation  is  voluntary  and  anonymous;  however,  your 
responses  are  important  and  will  be  given  serious  consideration. 

If  you  have  comments  that  you  would  prefer  to  discuss  on  the  telephone 
or  in  person,  you  may  call  CDR  Roy  Lahey  at  (619)225-6722  or  225-6400 
(Autovon  933-6722  or  933-6400).  In  the  event  you  want  to  elaborate  on 
your  response  to  a  particular  question,  use  the  extra  page  at  the  back 
of  this  questionnaire.  Feel  free  to  add  extra  pages  if  you  so  desire. 
Be  sure  to  reference  the  appropriate  question  in  your  remarks.  Mail 
the  completed  questionnaire  in  the  envelope  provided  within  10  days. 


BACKGROUND  INFORMATION  (QUESTIONS  1-7) 

1.  I  am  _ USN  _ USNR  _ TAR. 

2.  I  am  a  career  officer  _ Yes  _ No  _ Undecided 

3.  Male  _  Female 

4.  What  is  your  Rank? 


( 

) 

W-2 

(  )  ENS 

( 

) 

LCDR 

( 

) 

W-3 

(  )  LTJG 

( 

) 

CDR 

( 

) 

W-4 

(  )  LT 

( 

) 

CAPT 

5.  What  is  your  designator? 

6.  Which  best  describes  you? 

_ 1  Aviation  Officer  3  Submarine  Officer  _ 5  Corps  Officer 

2  Surface  Officer  4  Restricted  Line  Officer  6  Other 
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7.  Approximately  how  many  fitness  reports  have  you  written: 


In  the  past  twelve  months? 


During  your  career? 


(  )  none 

(  )  1-5 

(  )  6-10 
(  )  11-19 

(  )  20-29 

(  )  30  + 


(  )  none 

(  )  1-25 

(  )  26-49 

(  )  50-74 

(  )  75-99 

{  )  100+ 


EVALUATION  OF  THE  CURRENT  SYSTEM  (QUESTIONS  8-12) 

8.  Overall,  how  satisfied  are  you  with  the  current  officer  evaluation 
system? 

(  )  Very  satisfied  (  )  Satisfied  (  )  Undecided 

(  )  Dissatisfied  (  )  Very  dissatisfied 

9.  From  the  list  below,  select  the  3  characteristics  you  like  most 
about  the  current  fitness  report  system  and  the  3  characteristics 


you  like  least. 

Characteristics  of  the  Current 

LIKE 

MOST 

LIKE 

LEAST 

Fitness  Report  System 

(Mark 

3) 

( Mark  3 ) 

Single  form  for  all  grades 

( 

) 

( 

) 

Fairness 

( 

) 

( 

) 

Objectivity 

( 

) 

( 

) 

Subjectivity 

( 

) 

( 

) 

Opportunity  for  ratee  input 

( 

) 

( 

J 

Ranking  among  peers 

( 

) 

( 

) 

Letter  grade  evaluation 

( 

) 

( 

) 

Narrative  evaluation 

( 

) 

( 

) 

Work  sheet 

( 

) 

( 

) 

Quality  of  counseling  received 

( 

) 

( 

) 

Quantity  of  counseling  received 

( 

) 

( 

) 

Governing  instructions 

( 

)  1 

( 

) 

Effort  required  to  complete  form 

( 

) 

( 

) 

Inflation  (almost  everyone  rated 

"4.0")  ( 

) 

( 

) 
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10.  If  there  are  other  characteristics  of  the  current  fitness  report 
system  that  you  particularly  like  or  dislike,  besides  those 
listed  in  question  9,  please  list  them  here. 

CHARACTERISTICS  I  LIKE: 


CHARACTERISTICS  I  DISLIKE: 


11.  Grade  inflation  is  when  nearly  everyone  is  rated  "4.0."  It  is 
considered  to  be  a  problem  with  the  present  evaluation  system. 

How  do  you  feel  about  grade  inflation?  Mark  one  response. 

(  )  Not  a  problem  (  )  A  problem,  but  cannot  be  solved 

(  )  It  is  a  problem  that  could  possibly  be  reduced 

12.  Listed  below  are  nine  ways  that  officers  have  suggested  to  reduce 


or  eliminate  grade  inflation. 
ALL  that  you  recommend,  then  3  you 

Which  i 
would 

would 

MOST 

you  recommend?  Mark 
recommend . 

Methods  to  Reduce  Grade  Inflation 

RECOMMEND 
(Mark  All 

That  Apply) 

MOST  RECOMMEND 
(Mark  Top 

3  Only) 

Have  person  senior  to  rater 
review  and  sign  report 

( 

) 

( 

) 

Impose  penalties  on  raters 
who  inflate 

( 

) 

( 

) 

Keep  fitness  reports  secret 

( 

) 

( 

) 

More  emphasis  on  narrative, 
less  on  letter/number  grades 

( 

) 

( 

) 

Place  limit  on  the  percentage 
of  officers  who  can  be  put  in 
the  top-most  grading  blocks 

( 

) 

( 

) 

Apply  corrections  to  scores 
to  compensate  for  the  harshness 
or  leniency  of  a  given  rater 

( 

) 

( 

) 

Eliminate  up-or-out  aspect 
of  promotion 

( 

) 

( 

) 

Use  written  tests  to  supple¬ 
ment  the  fitness  report 

( 

) 

( 

) 

More  emphasis  on  letter/number 
grades,  less  on  narrative 

( 

) 

( 

) 
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If  there  are  other  methods  that  you  can  recommend  to  reduce  grade 
inflation,  please  list  them  here:  _ 


//  see  continuation  sheet 

COUNSELING  FUNCTION  OF  THE  EVALUATION  SYSTEM  (QUESTIONS  13-16) 


13.  As  a  ratee ,  have  you  been  criticized  due  to  a  misunder¬ 
standing  of  the  exact  nature  and  priorities  of  your  duties? 

(  )  Frequently 

(  )  Infrequently 

(  )  Almost  never 

(  )  Never 

14.  As  a  rater,  have  you  been  critical  of  your  subordinates 

when  they  did  not  understand  the  exact  nature  and  priorities  of 
their  duties? 

(  )  Frequently 

(  )  Infrequently 

(  )  Almost  never 

(  )  Never 

15.  Do  you  feel  that  there  should  be  a  formal  procedure  in  the 
counseling  process  for  clarifying  the  exact  nature  and  priorities 
of  a  subordinate's  duties? 

(  )  Definitely  yes 

(  )  Probably  yes 

(  )  Uncertain 

(  )  Probably  not 

(  )  Definitely  not 

16.  Assume  that  formal  discussions  of  assignments  (so  that  both 
rater  and  ratee  understand  explicitly  what  is  expected  of  the 
ratee)  and  periodic  reviews  of  an  officer's  performance  are  to  be 
conducted  on  one  or  more  occasions  during  each  fitness  report 
cycle.  On  the  timeline  below,  put  an  "A"  where  you  think  the 
Formal  Assignment  Conference ( s)  should  be  scheduled,  and  "P"  where 
you  think  the  Formal  Performance  Review(s)  should  take  place. 

f itrep 
due 

/ - / - / - / - / - / - / - / - / - / - / - / - / 

123456789  10  11  12 

Month 
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ALTERNATIVE  EVALUATION  SYSTEMS  (QUESTIONS  17-24) 

17.  In  an  open  evaluation  system  the  ratee  sees  the  fitness  report; 
in  a  closed  system  some  or  all  of  the  report  is  not  seen  by  the 
ratee.  How  do  you  feel  about  an  open  versus  closed  system? 

(  )  Strongly  prefer  an  open  system 

(  )  Prefer  an  open  system 

(  )  No  preference 

(  )  Prefer  a  closed  system 

(  )  Strongly  prefer  a  closed  system 

18.  Theoretically,  a  fitness  report  measures  only  performance,  not 
potential.  How  do  you  feel  about  the  suggestion  that  fitness 
reports  have  a  section  devoted  to  perceived  potential  of  the  ratee 
for  future  promotion? 

(  )  Strongly  favor 

(  )  Favor 

(  )  No  preference 

(  )  Opposed 

(  )  Strongly  opposed 


Shown  below  are  5  alternative  formats  and  rating  scales  for  evaluating 
an  officer's  overall  contribution  to  the  Navy.  For  each,  rate  how 
satisfactory  you  feel  that  form  is. 


19.  Current  Format 

Shown  below  are  Blocks  51  and  52  on  the  current  fitness  report 
form.  These  two  blocks  are  intended  to  represent  an  officer's 
overall  contribution  to  the  Navy.  In  the  EVALUATION  block  (51),  a 
rater  marks  a  particular  subordinate.  In  the  SUMMARY  block  (52), 
the  rater  indicates  all  the  ratings  he/she  has  given  to  officers 
of  the  subordinate's  grade. 


I  WUIOM  CONTMtunON 

MOT 

0*3 

^  '  M»QH 

1  1  1 

l«0 

1 

1 

1 

5  1 

|#1  EVALUATION  • 

X 

jM  sunnm 

2 

2 

1 

0 

1 

0 

0 

0 

0 

i 
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How  satisfactory  are  Blocks  51  and  52  on  the  current  Fitness  Report 
form? 


(  )  Very  satisfactory 

(  )  Satisfactory 

(  )  Undecided 

(  )  Unsatisfactory 

(  )  Very  unsatisfactory 

20.  Total  Range  of  Officer  Value  Format 


The  scale  running  from  1  to  45  below  is  intended  to  represent  the 
value  of  this  officer  in  accomplishing  the  mission  of  the  Navy,  as 
compared  with  the  other  officers  in  the  Navy.  A  rating  outside 
the  designated  range  for  officers  of  his/her  particular  rank  must 
be  substantiated  in  writing  and  evidence  cited.  (For  instance,  a 
rating  below  15  or  above  24  for  a  Lieutenant  requires  substantia¬ 
tion.)  Circle  the  number  reflecting  your  rating  of  this  officer. 


ENSIGN 

( 


CDR 

1 


1  2  3  4  5  6  7  8  9  101 11  12  13  14  15  16  17  18  19  20  21  22  23  24*  25  26  27  28*29  30  31  32  33  34  35  36  37  38*  39  40  41  42  43  44  45 
- — P -  i - 1 - 1  1 - 1 - 1 


LTJG 


LCDR 


CAP! 


How  satisfactory  do  you  feel  the  Total  Range  of  Officer  Value 
format  would  be? 


(  )  Very  satisfactory 

(  )  Satisfactory 

(  )  Undecided 

(  )  Unsatisfactory 

(  )  Very  unsatisfactory 

Comments  about  Total  Range  Format: 


7  7  see  continuation  sheet 


21.  Distance  from  Average  Format 

First  indicate  with  an  "0"  the  box  you  believe  to  be  appropriate 
for  the  average  officer  of  the  present  officer's  grade  and  length 
of  service.  Then  place  an  "X"  to  indicate  the  present  officer's 
performance  of  duty  in  comparison  with  the  average  officer  you 
indicated. 


BUTT  ASSIGNMENT 

HOT 

OBS 

OR 

H/A 

Outstanding 

Performance 

Excellent 

Performance. 

Frequently 

Demonstrates 

Outstanding 

Performance 

Very  good 

Performance. 

Frequently 

Demonatratea 

Excellent 

Performance 

Satisfactory 

Performance 

Basically 

Qualified 

Inadequate 

Performanca. 

8a  la  not 
Qualified 
(Adverse) 

(a)  Present  Assignment 

(b)  Shiphandling  and  Sesmsnshlp 

(c)  Airmanship 

(d)  Collateral  Duties 

(e)  As  Watch  Officer 

(f)  Technical  Specialty  (  ) 

(g)  Command  Potential  or  Ability 

(h)  Administrative  and  Management  Ability 

How  satisfactory  do  you  feel  the  Distance  from  Average 
format  would  be?  ^ 

(  )  Very  satisfactory 

(  )  Satisfactory 

(  )  Undecided 

(  )  Unsatisfactory 

(  )  Very  unsatisfactory 

Comments  about  Distance  from  Average  Format: _ 


/  /  see  continuation  sheet 


22.  Local  Distribution  Format 


Overall  Evaluation:  (a)  In  cowperieon  with  other  officers  for  hit  trade  and  approximate  length  »f  aarrlca,  how  would  ym u 
designate  this  officer? 

(h)  Tor  this  report  period  Indicate  In  (h)  bow  many  officer*  of  hla  trade  you  have  designated  In 
each  category  of  (a). 


not 

Observed 

Ooe  of  the 
Highly  Out¬ 
standing 
Officers 

1  Know 

A  Very  Floe 
Officer  of 

Crest  Value 
to  the 
Service 

A  Dependable 
and  typically 
Effective 
Officer 

An  Acceptable 
Officer 

Oaeat is factory 
(Adveree) 

(•) 

<b) 

How  satisfactory  do  you  feel  the  Local  Distribution  format 
would  be? 

(  )  Very  satisfactory 

(  )  Satisfactory 

(  )  Undecided 

(  )  Unsatisfactory 

(  )  Very  unsatisfactory 

Comments  about  Local  Distribution  Format: 


/  /  see  continuation  sheet 
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23.  Varying  Promotion  Rate  Format 


I  would  promote  this  officer  to  the  next  higher  grade  if  I  were  on 
a  promotion  board  meeting  next  month  to  select  for  promotion  the 
following  percentage  of  officers  in  his/her  grade.  (Check  only 
the  smallest  percentage  that  applies). 

()()()()()()()()()() 

Only  Only  Only  Only  Only  Only  Only  Only  Only 

1%  5%  10%  15%  20%  25%  40%  60%  80%  100% 

How  satisfactory  do  you  feel  the  Varying  Promotion  Rate 
format  would  be? 

(  )  Very  satisfactory 

(  )  Satisfactory 

(  )  Undecided 

(  )  Unsatisfactory 

(  )  Very  unsatisfactory 

Comments  about  Varying  Promotion  Rate  Format: _ 


//  see  continuation  sheet 

24.  Which,  if  any,  of  these  alternatives  would  you  rather  have  on  the 
Fitness  Report  form?  Rank  the  one  you  like  best  as  No.  1,  next 
best  No.  2,  etc. 

(  )  Blocks  51  and  52,  the  current  Fitness  Report 

(  )  "Total  Range  of  Officer  Value" 

(  )  "Distance  from  Average" 

(  )  "Local  Distribution" 

(  )  "Varying  Promotion  Rate" 

SELF-APPRAISAL  (QUESTIONS  25-28) 

The  following  questions  are  intended  to  help  the  research  team  under¬ 
stand  the  relationship  between  an  officer's  self-evaluation  and  the 

Navy's  evaluation  of  that  officer,  as  well  as  the  perceived  fairness 

of  the  system. 

25.  On  a  scale  of  1  to  1000,  with  1000  representing  the  top  performer 

and  500  the  average ,  where  would  you  rate  yourself  among  officers 
of  your  rank?  _ 

26.  On  the  same  scale,  where  do  you  think  the  Navy  (e.g.,  a  selection 

board)  would  rate  you?  _ 

27.  On  the  same  scale,  where  would  the  supervisor  who  completed  your 

last  fitness  report  rate  you?  _ 
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28.  What  was  your  last  fitness  report  rating?  Please  mark  below 


Ml  SSI  0*  CONTRIBUTION 

NOT 

OBS 

HIGH 

1  1  1 

MID 

1 

1 

LOW 

UARG 

NSAT* 

EVALUATION 

! 

1 

I 

1 

1 

1 

COMMENTS 

Your  comments  and  suggestions  about  the  present  officer  evaluation 
system  and  potential  alternatives  are  welcome.  Please  write  them 
below.  Use  blank  sheets  as  required. 


Thank  you  for  completing  this  questionnaire.  Please  return  it  in  the 
envelope  attached  to:  Navy  Personnel  Research  and  Development  Center 
(Code  14),  Attn:  CDR  Roy  Lahey,  San  Diego,  California  92152.  If  you 
would  like  to  be  telephoned  on  these  matters,  you  may  add  your  name 
and  phone  number  here : 
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APPENDIX  D 

DISTRIBUTIONS  OF  RATINGS 


D-0 


MIOPOINT 

SELFRATE 

SELF  RATING 

i 

FREQ 

CUM. 

FREQ 

PERCENT 

CUM. 

PERCENT 

400 

i 

|  * 

| 

1 

1 

0.34 

0.34 

450 

■ 

i 

1 

0 

1 

0.00 

0.34 

500 

1 

| *********** 

1 

1  L 

12 

3.74 

4.08 

550 

1 

(  ** 
i 

2 

14 

0.68 

4.76 

600 

1 

| ****** 
i 

6 

20 

2.04 

6.80 

650 

|  *** 

1 

3 

23 

1.02 

7.82 

700 

1 

| ***** 

1 

5 

28 

1.70 

9.52 

750 

1 

j  **************************** 
i 

28 

56 

9.52 

19.05 

800 

1 

| ********************************************** 

1 

46 

102 

15.65 

34.69 

850 

1 

| ***************************** 

t 

29 

131 

9.86 

44.56 

900 

i 

| *********************************************************** 
i 

59 

190 

20.07 

64.63 

950 

i 

| ***************************  ************************* 

1 

52 

242 

17.69 

82.31 

1000 

1 

| **************************************************** 

1 

52 

294 

17.69 

100.00 

5  10  15  20  25  30  35  40  45  50 

55 

FREQUENCY 


POINT 

*RATE 

400 

450 

500 

550 

600 

650 

700 

750 

800 

850 

900 

950 

1000 


WHERE  SUPERVISOR  WOULD 

RATE 

ME 

FREQ 

CUM. 

PERCENT 

CUM. 

FREQ 

PERCENT 

** 

2 

2 

0.68 

0.68 

0 

2 

0.00 

0.68 

*********** 

11 

13 

3.77 

4.45 

0 

13 

0.00 

4.45 

***** 

5 

18 

1.71 

6.16 

* 

1 

19 

0.34 

6.51 

************* 

13 

32 

4.45 

10.96 

*********** 

11 

43 

3.77 

14.73 

****************** 

18 

61 

6.16 

20.89 

************* 

13 

74 

4.45 

25.34 

********************** 

****************************#]M(.t##4t^,M#j' 

68 

142 

23.29 

48.63 

****************  ****************  **************************^ 

59 

201 

20.21 

68.84 

**********4******+************************1,if***1,m*mmmmmm*m^m^m"[M0* 

91 

292 

31.16 

100.00 

5  10  15  20 

25 

30  35  40  45  50  55  60  65  70  75  80  8^  90 

FREQUENCY 


>OINT 

f  RATE 

400 

450 

500 

550 

600 

650 

700 

750 

800 

850 

900 

950 

1000 


WHERE  NAVY  WOULD  RATE  ME 

FREQ 

CUM. 

FREQ 

PERCENT 

CUM. 

PERCENT 

j  44444 

5 

5 

1.72 

1.72 

1  * 

1 

6 

0.34 

2.07 

I  44444444444444444444444 

23 

29 

7.93 

10.00 

|  444 

3 

32 

1.03 

11.03 

j  444444 

6 

38 

2.07 

13.10 

| 44444 

5 

43 

1.72 

14.83 

j  444444444444444444 

18 

61 

6.21 

21.03 

j  44444444444444444 

17 

78 

5.86 

26.90 

j  44444444  44444  44  4  4444  4  444  444  4  4444  4 

33 

111 

11.38 

38.28 

j  444444444444444444444444444444 

30 

141 

10.34 

48.62 

| 44444444444444444444444444444444444444444444444444444444444 

59 

200 

20.34 

h- 

3* 

• 

CO 

o 

j  444  444  44  4  4  4444  44  4  44444  44  444  44  444  4444444 

39 

239 

13.45 

00 

tst 

• 

* 

** 

j  44444444  4  444  4  444  4  444  44  44  444444444444444444  444  4  44444 

51 

290 

17.59 

100.00 

+ - 4 - 4— - 4 - 4 - 4— - 4— - 4- - 4 - ♦ - 4 - 

5  10  15  20  25  30  35  40  45  50  55 


FREQUENCY 


DISTRIBUTION  LIST 


Military  Assistant  for  Training  and  Personnel  Technology  (OSUDS)  (R&AT) 

Deputy  Assistant  Secretary  of  the  Navy  (Manpower  and  Reserve  Affairs) 

Chief  of  Naval  Operations  (OP-01B7)  (2),  (OP-987H) 

Chief  of  Naval  Material  (NMAT  01M),  (NMAT  05),  (NMAT  0722) 

Commander,  Naval  Military  Personnel  Command  (NMPC-00),  (NMPC-013C),  (NMPC-32) 

Commanding  Officer,  Naval  Aerospace  Medical  Research  Laboratory 
Chief  of  Naval  Research  (Code  200),  (Code  400),  (Code  440),  (Code  442),  (Code  442PT) 
Officer  of  Naval  Research,  Detachment  Pasadena  (Code  00A),  (Code  N-21),  (Code  N-5) 
Chief  of  Naval  Technical  Training  (Code  N-6) 

Chief  of  Naval  Air  Training 

Commanding  Officer,  Naval  Training  Equipment  Center  (Technical  Library)  (5),  (Code  1) 
Commandant,  Coast  Guard  Headquarters 

Commanding  Officer,  U.S.  Coast  Guard  Research  and  Development  Center,  Avery  Point 
Superintendent,  Naval  Postgraduate  School 
President,  National  Defense  University  (3) 

Director  of  Research,  U.S.  Naval  Academy 
Secretary-Treasurer,  U.S.  Naval  Institute 
Defense  Technical  Information  Center  (DDA)  (12) 
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